-- Logs begin at Wed 2022-07-20 14:33:55 UTC, end at Wed 2022-07-20 15:49:22 UTC. -- Jul 20 15:10:18.448551 dv-cinder-819149-12-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 15:10:18.455993 dv-cinder-819149-12-smb devstack@keystone.service[80437]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 15:10:18.458538 dv-cinder-819149-12-smb devstack@keystone.service[80437]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 15:10:18 2022] *** Jul 20 15:10:18.458538 dv-cinder-819149-12-smb devstack@keystone.service[80437]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 15:10:18.458538 dv-cinder-819149-12-smb devstack@keystone.service[80437]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 15:10:18.458538 dv-cinder-819149-12-smb devstack@keystone.service[80437]: nodename: dv-cinder-819149-12-smb Jul 20 15:10:18.458538 dv-cinder-819149-12-smb devstack@keystone.service[80437]: machine: x86_64 Jul 20 15:10:18.458538 dv-cinder-819149-12-smb devstack@keystone.service[80437]: clock source: unix Jul 20 15:10:18.458538 dv-cinder-819149-12-smb devstack@keystone.service[80437]: pcre jit disabled Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: detected number of CPU cores: 4 Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: current working directory: / Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: detected binary path: /usr/bin/uwsgi-core Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: your processes number limit is 47680 Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: your memory page size is 4096 bytes Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: detected max file descriptor number: 2048 Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: lock engine: pthread robust mutexes Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: thunder lock: enabled Jul 20 15:10:18.459037 dv-cinder-819149-12-smb devstack@keystone.service[80437]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 15:10:18.459487 dv-cinder-819149-12-smb devstack@keystone.service[80437]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 15:10:18.503226 dv-cinder-819149-12-smb devstack@keystone.service[80437]: Python main interpreter initialized at 0x55e95246a9c0 Jul 20 15:10:18.503226 dv-cinder-819149-12-smb devstack@keystone.service[80437]: python threads support enabled Jul 20 15:10:18.503226 dv-cinder-819149-12-smb devstack@keystone.service[80437]: your server socket listen backlog is limited to 100 connections Jul 20 15:10:18.503226 dv-cinder-819149-12-smb devstack@keystone.service[80437]: your mercy for graceful operations on workers is 90 seconds Jul 20 15:10:18.503610 dv-cinder-819149-12-smb devstack@keystone.service[80437]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 15:10:18.503691 dv-cinder-819149-12-smb devstack@keystone.service[80437]: *** Operational MODE: preforking *** Jul 20 15:10:18.504071 dv-cinder-819149-12-smb devstack@keystone.service[80437]: *** uWSGI is running in multiple interpreter mode *** Jul 20 15:10:18.504071 dv-cinder-819149-12-smb devstack@keystone.service[80437]: spawned uWSGI master process (pid: 80437) Jul 20 15:10:18.504254 dv-cinder-819149-12-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 15:10:18.505719 dv-cinder-819149-12-smb devstack@keystone.service[80437]: spawned uWSGI worker 1 (pid: 80451, cores: 1) Jul 20 15:10:18.505910 dv-cinder-819149-12-smb devstack@keystone.service[80437]: spawned uWSGI worker 2 (pid: 80452, cores: 1) Jul 20 15:10:18.506077 dv-cinder-819149-12-smb devstack@keystone.service[80437]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 15:10:23.993346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:10:23.993346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jul 20 15:10:23.994160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:10:23.994160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: from cryptography.utils import int_from_bytes Jul 20 15:10:23.994160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:10:23.994160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: from cryptography.utils import int_from_bytes Jul 20 15:10:23.994700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:10:23.994700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jul 20 15:10:24.043450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:10:24.043602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:10:24.043703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:10:24.043797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:10:24.043873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] command line args: [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:10:24.043950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] command line args: [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:10:24.044095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:10:24.044178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:10:24.044284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ================================================================================ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:10:24.044374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ================================================================================ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:10:24.044547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] admin_token = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.044635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.044802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_dir = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.044884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config_dir = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config_source = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_source = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] debug = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] debug = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.045916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.046915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_config_append = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_config_append = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_dir = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_dir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.047939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.048989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.049974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.050118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.050213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.050369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.050457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.051274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.051456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.051545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.051770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.051953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.052142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] publish_errors = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.052361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.052445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.052550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] publish_errors = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.052636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.052779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.052866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] standard_threads = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.053922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] standard_threads = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_journal = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_json = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_stderr = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_journal = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_syslog = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.054933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_json = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.055070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_stderr = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.055223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.055301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_syslog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.055373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.055474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:10:24.055556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.055739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.055831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.055985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.056976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.057954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.058967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.059935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.060917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.061951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.062920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.063868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064115 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.064975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.065975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.066142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.066222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.066396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.067111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.067272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.067389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.067507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.067717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.067798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.067967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.068916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.069931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.070914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.071854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.072968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.073986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.074957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.075900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.076055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.076197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.076330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.076465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.076606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.076739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.076866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.077905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.078958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.079971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.080114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.080242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.080368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.080496 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.080628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.080754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.080889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.external = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.081920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.082049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.external = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.082174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.082328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.082469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.password = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.082600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.082788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.token = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.082788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.password = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.token = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.083953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084730 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.084990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.085126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.085254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.085383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.085383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.085652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.085781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.085918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.086950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.087988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.088187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.088315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.088447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.088574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.088699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.088831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.088964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.089099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.089225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.089351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.089483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.089615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.089747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.089878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.090938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.091972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.092108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.092235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.092361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.092488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.092624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.092752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.092888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.093927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.094061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.094188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.094291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.094481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.094610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.094752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.094888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.095918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.096952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097079 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.097979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.098106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.098291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.098436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.098563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.098737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.098865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.098993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.099132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.099262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.099391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.099518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.099646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.099788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.099924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.100949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.101997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.102126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.102264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.102392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.102520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.102667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.102793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.102922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.103972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.104999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.105135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.105262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.105398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.105529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.105658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.105784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.105911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.106037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.106175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.106303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.106438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.106566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.106700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.106867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.107920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.108961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.109988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.110122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.110251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.110377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.110512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.110655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.110783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.110920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.111937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.112961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.113093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.113815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.113956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.114150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.114289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.114475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.114606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.114772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.114912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.115961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.116090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.116230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.116359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.116487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.116625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.116753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.116880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.117912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.118845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.119974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.120107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.120244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.120372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.120497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.120624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.120751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.120885 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.121912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.122855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.123992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.124120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.124246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.124388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.124518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.124652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.124781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.124909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.125954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.126083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.126217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.126346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.126346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.126584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.126584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.126852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.127908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.128043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.128170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.128295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.128421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.128553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.128681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.128817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.129571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.129701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.129827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.129963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.130091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.130218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.130344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.130471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.130597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.130785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.130916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.131966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.132981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.133124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.133252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.133252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.133508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.133636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.133763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.133899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.134035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.134411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.134547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.134687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.134813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.134941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.135078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.135205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.135411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.135539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.135666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.135792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.135923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.136946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.137965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.138091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.138217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.138351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.138478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:10:24.138605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:10:24.138605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:10:24.162869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.163080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.163243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.163386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.163525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.163659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.171729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.171887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.200504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.200715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.200853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.200986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.344316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.344617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.394194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.394429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.395443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.395680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.459421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.459647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.459790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.459926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.460854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.485769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.485951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.486083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.486231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.486361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.486487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.486613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.486768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.486893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.487033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.487160 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.487297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.487426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.487551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.499141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.499697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.512827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.513943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.514028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.514155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.514238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.514439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.514678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 15:10:24.531993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.532207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:10:24.532548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.532753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:10:24.532900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.533032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:10:24.533163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.533292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.533422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.533551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 15:10:24.533686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.533815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.533941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.534079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.534239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.534497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.544870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.545145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.545415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.545699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.546086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.546366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.546656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.546942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.554444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.555681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.557740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.558023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.558307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.558734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.558998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.559140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.559271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.559399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.559526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.559666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.559792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.559927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.560054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.560206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.560338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.560466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.560605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.560735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.560991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.561265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.561539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.561812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.588422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.589510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.590035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.590320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.591155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.591436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.595661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.595903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.596183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.596694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.596975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.597257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.603532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.603815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.604673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.604959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.608426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.608715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.608995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.609278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.609554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.609648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.609829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.609912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.610100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.610182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.610368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.610450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.610670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.610939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.611209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.611478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.630708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.630986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.631346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.631623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.635821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.636504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.639487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.639783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.640158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.640452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.644925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.645481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.648642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.649117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.652438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.652740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.652910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.653039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.653209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.653333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.653509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.653602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.653793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.653885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.654078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.654357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.672866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.673248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.673333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.673519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.673646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.673787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.673920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.674189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.682793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.683350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.684503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.684780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.685069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.685348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.687838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.688121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.688403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.688485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.688688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.688783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.688965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.689049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.689243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.689540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.702965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.703249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.703531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.703736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.703819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.704016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.704109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.704297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.704382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.704579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.704664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.704867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.705168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.705445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.724057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.724979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.727392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.728290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.730698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.731627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.732313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.733228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.733944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.734224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.734518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.734894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.735178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.735469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.742721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.743518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.744277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.745152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.747542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.747844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.748135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.748417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.749192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.749495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.749784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.750799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.758245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.758534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.758843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.760500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.760788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.761075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.766980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.767268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.767548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.767825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.768098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.768391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.768667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.768908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 15:10:24.768996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.769189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.769285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.769460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.769593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.769786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.769875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.770056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.770143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.770322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.770411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.770596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.770715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.770893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.771165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.771444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.771721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.771981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.772244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.772511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 15:10:24.808950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e95246a9c0 pid: 80451 (default app) Jul 20 15:10:24.810827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e95246a9c0 pid: 80452 (default app) Jul 20 15:10:24.812285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017ef8f-ca3e-48cd-b8be-c380a2305aff None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:24.812581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017ef8f-ca3e-48cd-b8be-c380a2305aff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:24.812864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017ef8f-ca3e-48cd-b8be-c380a2305aff None None] PATH_INFO: `/v3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:24.817878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 791 bytes} [Wed Jul 20 15:10:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:33.499608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cda54-2c55-4264-afff-e29cb810c511 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:33.500165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cda54-2c55-4264-afff-e29cb810c511 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:33.500165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cda54-2c55-4264-afff-e29cb810c511 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:33.505093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1/2] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:10:33.510890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:33.511360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:33.511452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:33.580447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: INFO dbcounter [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] Registered counter for database keystone Jul 20 15:10:33.602735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG oslo_db.sqlalchemy.engines [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:10:33.609039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writer thread running {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:10:33.795734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG passlib.handlers.bcrypt [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80451) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 15:10:33.795734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG passlib.handlers.bcrypt [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80451) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 15:10:33.843478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:33.845121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:33.969216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 2/3] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 15:10:34.161091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cda54-2c55-4264-afff-e29cb810c511 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:34.235071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: INFO dbcounter [None req-107cda54-2c55-4264-afff-e29cb810c511 None None] Registered counter for database keystone Jul 20 15:10:34.255087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG oslo_db.sqlalchemy.engines [None req-107cda54-2c55-4264-afff-e29cb810c511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:10:34.261631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writer thread running {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:10:34.380688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cda54-2c55-4264-afff-e29cb810c511 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:34.385308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9962c-a555-42e7-acd4-f1eb24119742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:34.385969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9962c-a555-42e7-acd4-f1eb24119742 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:34.386268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9962c-a555-42e7-acd4-f1eb24119742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:34.386552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9962c-a555-42e7-acd4-f1eb24119742 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:34.394780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9962c-a555-42e7-acd4-f1eb24119742 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:34.446750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72f9962c-a555-42e7-acd4-f1eb24119742 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 15:10:34.447038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9962c-a555-42e7-acd4-f1eb24119742 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:34.458570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 2/4] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Jul 20 15:10:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:10:34.471066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:34.485744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768306-e509-4187-b849-e90e0e72e611 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:34.490854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3abf1-0dcf-4564-b4be-b384a3b1273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:34.492006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3abf1-0dcf-4564-b4be-b384a3b1273a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:34.492296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3abf1-0dcf-4564-b4be-b384a3b1273a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:34.492578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3abf1-0dcf-4564-b4be-b384a3b1273a admin admin] PATH_INFO: `/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:34.496713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3abf1-0dcf-4564-b4be-b384a3b1273a admin admin] RBAC: Authorizing `identity:get_project(project_id=f094b507fc2a4226a1c6a63fcbb399b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:34.546975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2fe3abf1-0dcf-4564-b4be-b384a3b1273a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 15:10:34.547524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3abf1-0dcf-4564-b4be-b384a3b1273a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:34.552478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 3/5] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Jul 20 15:10:34 2022] GET /identity/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:36.563437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53db37-a0e1-46a9-816a-84fcce747aed None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:36.563935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53db37-a0e1-46a9-816a-84fcce747aed None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:36.564022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53db37-a0e1-46a9-816a-84fcce747aed None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:36.568179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 3/6] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:36.573593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b796a1-3334-4ac1-8dcb-af02c43fe96f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:36.574022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b796a1-3334-4ac1-8dcb-af02c43fe96f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:36.574168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b796a1-3334-4ac1-8dcb-af02c43fe96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:36.593307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-96b796a1-3334-4ac1-8dcb-af02c43fe96f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:36.594850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-96b796a1-3334-4ac1-8dcb-af02c43fe96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:36.603444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 4/7] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 15:10:36.625343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53db37-a0e1-46a9-816a-84fcce747aed None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:36.637488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53db37-a0e1-46a9-816a-84fcce747aed None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:36.641637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff0b9-d9db-4ad0-85cb-ec4626af0f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:36.642259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff0b9-d9db-4ad0-85cb-ec4626af0f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:36.642544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff0b9-d9db-4ad0-85cb-ec4626af0f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:36.642858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff0b9-d9db-4ad0-85cb-ec4626af0f96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:36.650942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff0b9-d9db-4ad0-85cb-ec4626af0f96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:36.652722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff0b9-d9db-4ad0-85cb-ec4626af0f96 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:36.662065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 4/8] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Jul 20 15:10:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:10:36.667470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b796a1-3334-4ac1-8dcb-af02c43fe96f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:36.676478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b796a1-3334-4ac1-8dcb-af02c43fe96f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:36.680868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593c3c4-a279-43cf-9c50-34ed92365206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:36.681724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593c3c4-a279-43cf-9c50-34ed92365206 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:36.682012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593c3c4-a279-43cf-9c50-34ed92365206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:36.682292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593c3c4-a279-43cf-9c50-34ed92365206 admin admin] PATH_INFO: `/v3/users/45390c2d5e85402a95796746fd244a1c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:36.683739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593c3c4-a279-43cf-9c50-34ed92365206 admin admin] RBAC: Authorizing `identity:get_user(user_id=45390c2d5e85402a95796746fd244a1c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:36.685564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593c3c4-a279-43cf-9c50-34ed92365206 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:36.687165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 5/9] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Jul 20 15:10:36 2022] GET /identity/v3/users/45390c2d5e85402a95796746fd244a1c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:38.775833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499459c6-127b-4c1a-80b0-eb224b6dde4f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:38.776333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499459c6-127b-4c1a-80b0-eb224b6dde4f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:38.776333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499459c6-127b-4c1a-80b0-eb224b6dde4f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:38.777657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 5/10] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:38.782829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f08f-67d6-487e-8d49-ced8a35d95ae None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:38.783238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f08f-67d6-487e-8d49-ced8a35d95ae None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:38.783399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f08f-67d6-487e-8d49-ced8a35d95ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:38.800245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e735f08f-67d6-487e-8d49-ced8a35d95ae None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:38.801970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e735f08f-67d6-487e-8d49-ced8a35d95ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:38.815084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514737c5-3929-4a3a-b98d-baa7eee315fa None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:38.815378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514737c5-3929-4a3a-b98d-baa7eee315fa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:38.815662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514737c5-3929-4a3a-b98d-baa7eee315fa None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:38.818024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 6/11] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:38.822819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:38.823110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:38.823396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:38.862788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80452) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 15:10:38.863973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80452) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 15:10:38.883340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 6/12] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:38.906463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735f08f-67d6-487e-8d49-ced8a35d95ae None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:38.910340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:38.911982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:38.930508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:39.011644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735f08f-67d6-487e-8d49-ced8a35d95ae None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.012975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 7/13] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:10:39.034960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:39.045972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.046878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.047170 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.047451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.060568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:39.072517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:39.073532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:10:39.074431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 7/14] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:10:39.079467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:39.137211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d58f1e-40ec-48c5-aa35-c0378368d117 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.140202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:39.162295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:39.173817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.174802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.175093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.175373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.180495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df61365-2569-4987-a312-9118cef4d1ea None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.214151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.214856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.215155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.215432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.216179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:39.216486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:39.217879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:39.230522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 8/15] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:39.236048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:39.244054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:39.245582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:39.335493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34fd4d-a6ce-4900-aa40-7d556f03e2d3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.341398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 8/16] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:10:39.347968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:39.350707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:39.369978 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.370884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.371173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.371451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] PATH_INFO: `/v3/users/45390c2d5e85402a95796746fd244a1c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.372677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] RBAC: Authorizing `identity:get_user(user_id=45390c2d5e85402a95796746fd244a1c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:39.374124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:39.375820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 9/17] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:39 2022] GET /identity/v3/users/45390c2d5e85402a95796746fd244a1c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:39.381167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:39.395393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:39.447642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1b603-cbe7-4c63-88ab-d3b560003f6a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.481411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02b202-5f58-4376-8965-46355a1f1686 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.482217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.483046 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.483335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.483612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.502380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:39.503955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:39.516579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.517375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.517657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.517935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.519137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:39.521209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:39.522832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 10/18] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:10:39.525766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:39.526762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:39.528713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:10:39.528713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:10:39.528713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:10:39.528713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:39.528713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 9/19] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:10:39.529234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:39.532505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:39.588145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:39.608132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:39.626574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b319-0de6-4415-b591-51ff1279d9e5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.630844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998808-5e8f-4a42-8ce0-d8b9ae6c9821 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:39.663935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1468b0a-0365-430c-9acb-20084e3c2e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.664590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468b0a-0365-430c-9acb-20084e3c2e3f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.664876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468b0a-0365-430c-9acb-20084e3c2e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.665157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1468b0a-0365-430c-9acb-20084e3c2e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.665337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1996b-e3ba-43f7-a594-0de6761afb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:39.666003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468b0a-0365-430c-9acb-20084e3c2e3f None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.domain.id=default, user.id=45390c2d5e85402a95796746fd244a1c) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:39.666100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1996b-e3ba-43f7-a594-0de6761afb51 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:39.666291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1996b-e3ba-43f7-a594-0de6761afb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:39.666390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468b0a-0365-430c-9acb-20084e3c2e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:39.666573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1996b-e3ba-43f7-a594-0de6761afb51 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:39.667341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1996b-e3ba-43f7-a594-0de6761afb51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:39.667656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1996b-e3ba-43f7-a594-0de6761afb51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:39.667795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1468b0a-0365-430c-9acb-20084e3c2e3f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:39.669038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1996b-e3ba-43f7-a594-0de6761afb51 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:39.674475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 11/20] 10.222.0.87 () {56 vars in 1322 bytes} [Wed Jul 20 15:10:39 2022] GET /identity/v3/role_assignments?user.id=45390c2d5e85402a95796746fd244a1c&scope.domain.id=default&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:39.687556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 10/21] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:41.911495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56dad5-f239-4c75-a298-861271a31961 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:41.912513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56dad5-f239-4c75-a298-861271a31961 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:41.913018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56dad5-f239-4c75-a298-861271a31961 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:41.914917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 12/22] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:41.919905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345b0c-9227-417c-a69d-d6074cc8a884 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:41.920715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345b0c-9227-417c-a69d-d6074cc8a884 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:41.921214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10345b0c-9227-417c-a69d-d6074cc8a884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:41.943630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-10345b0c-9227-417c-a69d-d6074cc8a884 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:41.945180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-10345b0c-9227-417c-a69d-d6074cc8a884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:42.032382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 11/23] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:42.067761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56dad5-f239-4c75-a298-861271a31961 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:42.108095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc499-20ae-4408-834b-f17f7403215c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.108714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc499-20ae-4408-834b-f17f7403215c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.109220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cc499-20ae-4408-834b-f17f7403215c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.110909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 12/24] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:42.117310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd82ce-7857-4ddd-9159-1fd596d3690a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.117862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd82ce-7857-4ddd-9159-1fd596d3690a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.118341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd82ce-7857-4ddd-9159-1fd596d3690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.148764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-38cd82ce-7857-4ddd-9159-1fd596d3690a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:42.150339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-38cd82ce-7857-4ddd-9159-1fd596d3690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:42.239599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:42.285485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 13/25] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:42.292239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56dad5-f239-4c75-a298-861271a31961 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:42.319118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd82ce-7857-4ddd-9159-1fd596d3690a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:42.348439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927f2b-7129-4170-9836-18dc446206f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:42.349567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927f2b-7129-4170-9836-18dc446206f5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.349859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927f2b-7129-4170-9836-18dc446206f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.350144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927f2b-7129-4170-9836-18dc446206f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.371175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b927f2b-7129-4170-9836-18dc446206f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8b927f2b-7129-4170-9836-18dc446206f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:42.384754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:42.385634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:10:42.386398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 13/26] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:42.387860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef06dea-5bfd-41e6-85c9-99cc048e7ce8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.387860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef06dea-5bfd-41e6-85c9-99cc048e7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.387860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef06dea-5bfd-41e6-85c9-99cc048e7ce8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.389896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 14/27] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:42.399713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef06dea-5bfd-41e6-85c9-99cc048e7ce8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:42.405232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:42.454453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd82ce-7857-4ddd-9159-1fd596d3690a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:42.495309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:42.495924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.496210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.496489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.497270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:42.498704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:42.576030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef06dea-5bfd-41e6-85c9-99cc048e7ce8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:42.634969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c87e8-763c-4091-b11d-3be98e9c65a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:42.636005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c87e8-763c-4091-b11d-3be98e9c65a4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.636443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c87e8-763c-4091-b11d-3be98e9c65a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.636863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c87e8-763c-4091-b11d-3be98e9c65a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.637821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c87e8-763c-4091-b11d-3be98e9c65a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:42.640208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c87e8-763c-4091-b11d-3be98e9c65a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:42.641819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c87e8-763c-4091-b11d-3be98e9c65a4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:42.661126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 15/28] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:42.664369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9b5c-8ec7-4fc2-831c-3d9eae8d40ec None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.664811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9b5c-8ec7-4fc2-831c-3d9eae8d40ec None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.665232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9b5c-8ec7-4fc2-831c-3d9eae8d40ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.701521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-739f9b5c-8ec7-4fc2-831c-3d9eae8d40ec None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:42.703057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-739f9b5c-8ec7-4fc2-831c-3d9eae8d40ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:42.804041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:42.812318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 16/29] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:42.813345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9b5c-8ec7-4fc2-831c-3d9eae8d40ec None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:42.839411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 14/30] 10.222.0.87 () {60 vars in 1131 bytes} [Wed Jul 20 15:10:42 2022] POST /identity/v3/roles => generated 219 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:10:42.877067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:42.927320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9b5c-8ec7-4fc2-831c-3d9eae8d40ec None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:42.940033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:42.966020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e71c-f9be-4d42-9398-fd5915824e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:42.966951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e71c-f9be-4d42-9398-fd5915824e04 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.967387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e71c-f9be-4d42-9398-fd5915824e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.967670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e71c-f9be-4d42-9398-fd5915824e04 None admin] PATH_INFO: `/v3/users/45390c2d5e85402a95796746fd244a1c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.969145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e71c-f9be-4d42-9398-fd5915824e04 None admin] RBAC: Authorizing `identity:get_user(user_id=45390c2d5e85402a95796746fd244a1c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:42.970630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e71c-f9be-4d42-9398-fd5915824e04 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:42.972386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 17/31] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:42 2022] GET /identity/v3/users/45390c2d5e85402a95796746fd244a1c => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:42.973614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818333d-32d6-45d7-8e81-4b3866e93fba None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:42.973905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818333d-32d6-45d7-8e81-4b3866e93fba None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:42.974252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818333d-32d6-45d7-8e81-4b3866e93fba None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:42.975628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 18/32] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:42.980658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818333d-32d6-45d7-8e81-4b3866e93fba None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:43.059253 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:43.092227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818333d-32d6-45d7-8e81-4b3866e93fba None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:43.104965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444aab6-cdf2-43b9-a0e0-90be2306bbbd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:43.136063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89f6b-165c-425d-9351-79c645180aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:43.136876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89f6b-165c-425d-9351-79c645180aec None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.137162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89f6b-165c-425d-9351-79c645180aec None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.137442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89f6b-165c-425d-9351-79c645180aec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.138831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89f6b-165c-425d-9351-79c645180aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:43.140566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89f6b-165c-425d-9351-79c645180aec None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:43.142502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 19/33] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:43.145357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9656-9883-48e1-a1ef-6fcce024b05c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.145897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9656-9883-48e1-a1ef-6fcce024b05c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.146416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe9656-9883-48e1-a1ef-6fcce024b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.167078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fffe9656-9883-48e1-a1ef-6fcce024b05c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:43.168714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fffe9656-9883-48e1-a1ef-6fcce024b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:43.170821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:43.171638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.171929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.172212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.184705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:43.186495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:10:43.208863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:43.209756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:43.211260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:10:43.211260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:10:43.211260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:10:43.211260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:43.211260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 15/34] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:10:43.211260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:43.261186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 20/35] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:43.262381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe9656-9883-48e1-a1ef-6fcce024b05c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:43.343815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:43.347004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:43.361522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb065-810d-43f7-aae3-64655331a0f5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:43.399850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe9656-9883-48e1-a1ef-6fcce024b05c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:43.409244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:43.410750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.411267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.411747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] PATH_INFO: `/v3/domains/default/users/45390c2d5e85402a95796746fd244a1c/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.414510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=45390c2d5e85402a95796746fd244a1c, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:43.418805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:43.439080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:43.441702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.441702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.441702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.441702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:43.442034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:43.443301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:43.461881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 21/36] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:43.462557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:43.531257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 16/37] 10.222.0.87 () {58 vars in 1361 bytes} [Wed Jul 20 15:10:43 2022] PUT /identity/v3/domains/default/users/45390c2d5e85402a95796746fd244a1c/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:10:43.532698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:43.607151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d61a1-dccc-4eca-8ca6-3308334462c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:43.649387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:43.663602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:43.664297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.664586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.664870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.665649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:43.667296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:43.686705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e7ce-93c8-43a1-b9d2-137a79bc33b7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:43.725155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a6a7e-5685-4b90-ad3e-23f36c621e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:43.725834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6a7e-5685-4b90-ad3e-23f36c621e98 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.726125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6a7e-5685-4b90-ad3e-23f36c621e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.726411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6a7e-5685-4b90-ad3e-23f36c621e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.727182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6a7e-5685-4b90-ad3e-23f36c621e98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:43.728660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6a7e-5685-4b90-ad3e-23f36c621e98 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:43.822954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:43.833067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 17/38] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:10:43 2022] POST /identity/v3/projects => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:10:43.833067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bdf57-824d-4083-9b56-15ad8eab50b5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.833067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bdf57-824d-4083-9b56-15ad8eab50b5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.833067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bdf57-824d-4083-9b56-15ad8eab50b5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.833067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 18/39] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:43.834087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b043e-c816-4cd5-b4f6-6a237d4da2d2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.834680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b043e-c816-4cd5-b4f6-6a237d4da2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.834680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b043e-c816-4cd5-b4f6-6a237d4da2d2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.836213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 19/40] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:43.838412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5efe2-e250-4584-bdf1-4af892604bcc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.838807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5efe2-e250-4584-bdf1-4af892604bcc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.839094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5efe2-e250-4584-bdf1-4af892604bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.859843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-15a5efe2-e250-4584-bdf1-4af892604bcc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:43.861599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-15a5efe2-e250-4584-bdf1-4af892604bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:43.948182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 20/41] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:10:43.949695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69752-9544-48ef-a9c5-40357251d25b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:43.949988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69752-9544-48ef-a9c5-40357251d25b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:43.950317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa69752-9544-48ef-a9c5-40357251d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:43.967525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 22/42] 10.222.0.87 () {60 vars in 1131 bytes} [Wed Jul 20 15:10:43 2022] POST /identity/v3/roles => generated 225 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:10:43.973374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8fa69752-9544-48ef-a9c5-40357251d25b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:43.974980 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8fa69752-9544-48ef-a9c5-40357251d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:43.988834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:44.073123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 21/43] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:44.106335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69752-9544-48ef-a9c5-40357251d25b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:44.155440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd87e5-ced9-4765-908d-3fa5933b1e50 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:44.183589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:44.194422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:44.195584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:44.195762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:44.201697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:44.201697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:44.201697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:44.201697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 23/44] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:44.206453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:44.235372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa69752-9544-48ef-a9c5-40357251d25b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:44.266796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:44.276778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee772886-4a79-486d-b702-e792cb0492bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:44.281414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772886-4a79-486d-b702-e792cb0492bd None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:44.281414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772886-4a79-486d-b702-e792cb0492bd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:44.281414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772886-4a79-486d-b702-e792cb0492bd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:44.281414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee772886-4a79-486d-b702-e792cb0492bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:44.281414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee772886-4a79-486d-b702-e792cb0492bd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:44.320770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4fc89-5a06-451c-9f70-6f11447529c6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:44.354047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21003-5a58-4ba8-8032-2318198b7103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:44.354759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21003-5a58-4ba8-8032-2318198b7103 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:44.355056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21003-5a58-4ba8-8032-2318198b7103 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:44.355340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21003-5a58-4ba8-8032-2318198b7103 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:44.356056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21003-5a58-4ba8-8032-2318198b7103 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:44.357561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21003-5a58-4ba8-8032-2318198b7103 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:44.371568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 22/45] 10.222.0.87 () {60 vars in 1131 bytes} [Wed Jul 20 15:10:44 2022] POST /identity/v3/roles => generated 223 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:10:44.466763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 24/46] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:10:44 2022] POST /identity/v3/projects => generated 312 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:10:45.666100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec95f2-85b6-4b90-bbff-491fa776a53c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:45.666624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec95f2-85b6-4b90-bbff-491fa776a53c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:45.666735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec95f2-85b6-4b90-bbff-491fa776a53c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:45.668120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 23/47] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:45.673437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f77b8-fff6-4658-84f8-47021c710bf3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:45.673842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f77b8-fff6-4658-84f8-47021c710bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:45.674011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f77b8-fff6-4658-84f8-47021c710bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:45.691550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-360f77b8-fff6-4658-84f8-47021c710bf3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:45.693063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-360f77b8-fff6-4658-84f8-47021c710bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:45.757990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 25/48] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:45.781050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec95f2-85b6-4b90-bbff-491fa776a53c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:45.883571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec95f2-85b6-4b90-bbff-491fa776a53c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:45.904178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:45.918393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:45.919208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:45.919493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:45.919766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:45.931571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:45.940388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:45.941401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:45.942312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 24/49] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:45.947968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f77b8-fff6-4658-84f8-47021c710bf3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:45.979090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:46.047263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f77b8-fff6-4658-84f8-47021c710bf3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:46.080543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:46.081215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.081501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.082472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.083354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:46.083670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:46.085072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:46.093253 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 26/50] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:46.099413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:46.303517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe019e-5c7a-4b9d-8b98-abd44feac4e0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:46.337369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:46.338277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.338564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.338874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] PATH_INFO: `/v3/users/45390c2d5e85402a95796746fd244a1c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.340168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] RBAC: Authorizing `identity:get_user(user_id=45390c2d5e85402a95796746fd244a1c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:46.341631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:46.343316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 25/51] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:46 2022] GET /identity/v3/users/45390c2d5e85402a95796746fd244a1c => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:46.348998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:46.443010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:46.449543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c9257-81b2-452f-9a2e-8ca0499eb4a2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:46.483411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16fad9-4d4c-438e-afbd-8e05580c4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:46.484208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16fad9-4d4c-438e-afbd-8e05580c4dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.484499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16fad9-4d4c-438e-afbd-8e05580c4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.484778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16fad9-4d4c-438e-afbd-8e05580c4dd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.485950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16fad9-4d4c-438e-afbd-8e05580c4dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:46.487446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16fad9-4d4c-438e-afbd-8e05580c4dd6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:46.489091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 27/52] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:46.494920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:46.535661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7667-383a-49d2-a9d9-347284ac4644 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.535959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7667-383a-49d2-a9d9-347284ac4644 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.536247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e7667-383a-49d2-a9d9-347284ac4644 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.537628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 28/53] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:10:46.542402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84afa-9eb1-4391-8ff4-66c3ae2fbbd0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.542716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84afa-9eb1-4391-8ff4-66c3ae2fbbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.543024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84afa-9eb1-4391-8ff4-66c3ae2fbbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.546832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:46.560021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f7c84afa-9eb1-4391-8ff4-66c3ae2fbbd0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:46.561163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f7c84afa-9eb1-4391-8ff4-66c3ae2fbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:46.598276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cb2ff-3f94-4b70-893d-aa3b16511477 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:46.628356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 29/54] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:10:46.633200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:46.633933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.634290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.634939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.635783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.domain.id=default, user.id=45390c2d5e85402a95796746fd244a1c) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:46.636109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:46.637555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:46.646800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 26/55] 10.222.0.87 () {56 vars in 1322 bytes} [Wed Jul 20 15:10:46 2022] GET /identity/v3/role_assignments?user.id=45390c2d5e85402a95796746fd244a1c&scope.domain.id=default&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:46.652544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c84afa-9eb1-4391-8ff4-66c3ae2fbbd0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:46.749013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:46.759005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c84afa-9eb1-4391-8ff4-66c3ae2fbbd0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:46.795919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94991b85-db9c-46ef-8d5f-4805c425c07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:46.796731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991b85-db9c-46ef-8d5f-4805c425c07c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.797030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991b85-db9c-46ef-8d5f-4805c425c07c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.797303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991b85-db9c-46ef-8d5f-4805c425c07c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.798491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94991b85-db9c-46ef-8d5f-4805c425c07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:46.799986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94991b85-db9c-46ef-8d5f-4805c425c07c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:46.802069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 30/56] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:46.807825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:46.910043 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4375aab-33fc-4e9a-a973-fc8ab652676b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:46.922720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:46.944113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6316ea2-2a4d-4e79-baae-38f5ecb65189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:46.944782 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6316ea2-2a4d-4e79-baae-38f5ecb65189 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:46.945073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6316ea2-2a4d-4e79-baae-38f5ecb65189 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:46.945357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6316ea2-2a4d-4e79-baae-38f5ecb65189 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:46.946130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6316ea2-2a4d-4e79-baae-38f5ecb65189 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:46.947630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6316ea2-2a4d-4e79-baae-38f5ecb65189 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:47.045652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 27/57] 10.222.0.87 () {60 vars in 1140 bytes} [Wed Jul 20 15:10:46 2022] POST /identity/v3/projects => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:10:49.081541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddf421-b46c-4450-af44-c7eb76e2a46c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:49.082133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddf421-b46c-4450-af44-c7eb76e2a46c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:49.082133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddf421-b46c-4450-af44-c7eb76e2a46c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:49.083506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 31/58] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:49.088699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e503e4-34ea-4c8f-b76e-186f1b2e9c90 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:49.089115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e503e4-34ea-4c8f-b76e-186f1b2e9c90 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:49.089269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e503e4-34ea-4c8f-b76e-186f1b2e9c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:49.106811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c6e503e4-34ea-4c8f-b76e-186f1b2e9c90 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:49.108003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c6e503e4-34ea-4c8f-b76e-186f1b2e9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:49.172514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 28/59] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:49.197264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddf421-b46c-4450-af44-c7eb76e2a46c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:49.297138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddf421-b46c-4450-af44-c7eb76e2a46c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:49.330354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5e7a7-243d-4e6b-8e58-a0a658c93dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:49.331175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e7a7-243d-4e6b-8e58-a0a658c93dad None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:49.331466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e7a7-243d-4e6b-8e58-a0a658c93dad None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:49.332353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e7a7-243d-4e6b-8e58-a0a658c93dad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:49.333493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5e7a7-243d-4e6b-8e58-a0a658c93dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:49.334981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5e7a7-243d-4e6b-8e58-a0a658c93dad None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:49.336600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 32/60] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:49.342078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e503e4-34ea-4c8f-b76e-186f1b2e9c90 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:49.432053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:49.438488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e503e4-34ea-4c8f-b76e-186f1b2e9c90 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:49.470926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe001bbe-0340-4b34-a74b-85a7df35cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:49.471585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001bbe-0340-4b34-a74b-85a7df35cf84 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:49.471873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001bbe-0340-4b34-a74b-85a7df35cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:49.472236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe001bbe-0340-4b34-a74b-85a7df35cf84 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:49.473430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe001bbe-0340-4b34-a74b-85a7df35cf84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:49.474907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe001bbe-0340-4b34-a74b-85a7df35cf84 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:49.591971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 29/61] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:10:49 2022] POST /identity/v3/users => generated 275 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:10:52.683323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37551d95-c802-411a-bf23-7bbb6008eea2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:52.684302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37551d95-c802-411a-bf23-7bbb6008eea2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:52.684783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37551d95-c802-411a-bf23-7bbb6008eea2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:52.686598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 33/62] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:52.693770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53b532-db73-4da6-8db5-a736d757d8f2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:52.694682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53b532-db73-4da6-8db5-a736d757d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:52.695266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53b532-db73-4da6-8db5-a736d757d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:52.724848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d53b532-db73-4da6-8db5-a736d757d8f2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:52.726363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d53b532-db73-4da6-8db5-a736d757d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:52.823928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 30/63] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:52.872772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37551d95-c802-411a-bf23-7bbb6008eea2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:52.909238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:52.955169 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342599e-0996-4643-9cd2-1d820f740383 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:52.955787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342599e-0996-4643-9cd2-1d820f740383 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:52.956265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342599e-0996-4643-9cd2-1d820f740383 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:52.958719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 31/64] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:52.965166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b136-e067-45d6-a439-592f0bdc07b7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:52.965732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b136-e067-45d6-a439-592f0bdc07b7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:52.966210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b136-e067-45d6-a439-592f0bdc07b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:52.999353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a0a8b136-e067-45d6-a439-592f0bdc07b7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:53.001230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a0a8b136-e067-45d6-a439-592f0bdc07b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:53.026548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37551d95-c802-411a-bf23-7bbb6008eea2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.100409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.101222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.101508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.101786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.122746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:53.125774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 32/65] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:10:53.127364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad709e4-6713-4ae5-8d8d-2dec107ecc07 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.127906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad709e4-6713-4ae5-8d8d-2dec107ecc07 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.128554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad709e4-6713-4ae5-8d8d-2dec107ecc07 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.130310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 33/66] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:53.130677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:53.131546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:10:53.132311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:10:53.134477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 34/67] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:53.135763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154fe41-bff3-43ed-8cdf-fc6a22164d91 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.136121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154fe41-bff3-43ed-8cdf-fc6a22164d91 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.136471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154fe41-bff3-43ed-8cdf-fc6a22164d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.147531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.158386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a154fe41-bff3-43ed-8cdf-fc6a22164d91 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:53.160553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a154fe41-bff3-43ed-8cdf-fc6a22164d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:53.163838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.230887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 34/68] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:53.232462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc61e-fa79-4026-8f95-bd414dda16cb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.232759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc61e-fa79-4026-8f95-bd414dda16cb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.233047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc61e-fa79-4026-8f95-bd414dda16cb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.234469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 35/69] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:53.239122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbc61e-fa79-4026-8f95-bd414dda16cb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.264899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.277582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f2884-8fb0-4973-8695-81267c4af140 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.314178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608f2cd-8572-4867-b618-56375b3dfb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.314881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f2cd-8572-4867-b618-56375b3dfb3d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.315177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f2cd-8572-4867-b618-56375b3dfb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.315464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f2cd-8572-4867-b618-56375b3dfb3d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.316253 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608f2cd-8572-4867-b618-56375b3dfb3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:53.316766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608f2cd-8572-4867-b618-56375b3dfb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:53.318316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608f2cd-8572-4867-b618-56375b3dfb3d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:53.331075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 35/70] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:53.331075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e05d9-d9d1-4259-994e-723caeae4ca1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.331075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e05d9-d9d1-4259-994e-723caeae4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.331075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e05d9-d9d1-4259-994e-723caeae4ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.345276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9a5e05d9-d9d1-4259-994e-723caeae4ca1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:53.346478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9a5e05d9-d9d1-4259-994e-723caeae4ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:53.354394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbc61e-fa79-4026-8f95-bd414dda16cb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.391664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.392481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.392769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.393049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.401777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.404685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:53.413776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:53.417820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 36/71] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:53.418593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.423489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 36/72] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:53.429751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e05d9-d9d1-4259-994e-723caeae4ca1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.528668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.540895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ce8a-3775-413d-a5db-2f89c31bdd4e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.547752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e05d9-d9d1-4259-994e-723caeae4ca1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.575900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.576694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.576982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.577261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.583792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.584666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.584954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.585239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.588490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:53.596087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:53.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:53.598125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 37/73] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:53.599085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.599913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:53.601409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:53.603258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 37/74] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:53.604030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.659958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.699474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d9bc8-6cbf-4246-a076-e60e81b050c5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.702449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e06e4-c217-429b-a03a-43d638952de5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.732861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e85d3-43eb-467d-9970-995a7dca66d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.733537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e85d3-43eb-467d-9970-995a7dca66d2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.733840 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e85d3-43eb-467d-9970-995a7dca66d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.734120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e85d3-43eb-467d-9970-995a7dca66d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.734903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e85d3-43eb-467d-9970-995a7dca66d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:53.735216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e85d3-43eb-467d-9970-995a7dca66d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:53.735429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.736226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.736517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.736617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e85d3-43eb-467d-9970-995a7dca66d2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:53.736796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.743900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.748193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:53.748916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 38/75] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:53.750184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b075-09d3-46f7-a164-09c817d47d4e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.750534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b075-09d3-46f7-a164-09c817d47d4e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.750851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b075-09d3-46f7-a164-09c817d47d4e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.754777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 39/76] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:53.754777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b075-09d3-46f7-a164-09c817d47d4e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:53.756820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:53.761587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 38/77] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:53.762376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.858544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0f70b-323f-4999-86d7-a1f2496f7fb1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.859076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b075-09d3-46f7-a164-09c817d47d4e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:53.882348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.893497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.893791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:53.894147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.894716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.894829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:53.894915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.894993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:53.895069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:53.895818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:53.896133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:53.897608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:53.905509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 40/78] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:53.910922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:53.958902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:53.962369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:53.963895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.006546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8ea6-e9fd-4860-b2f7-a7922a50844b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.039532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddb78f-62d4-460e-9dbc-b53d2d7d3034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.040401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb78f-62d4-460e-9dbc-b53d2d7d3034 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.040683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb78f-62d4-460e-9dbc-b53d2d7d3034 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.040961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb78f-62d4-460e-9dbc-b53d2d7d3034 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.042208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddb78f-62d4-460e-9dbc-b53d2d7d3034 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.043689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddb78f-62d4-460e-9dbc-b53d2d7d3034 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.045319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 41/79] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:54.046481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e2cc3-ec68-4b28-a4ee-b8611877af04 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.046797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e2cc3-ec68-4b28-a4ee-b8611877af04 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.047077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e2cc3-ec68-4b28-a4ee-b8611877af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.063149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-322e2cc3-ec68-4b28-a4ee-b8611877af04 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:54.064356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-322e2cc3-ec68-4b28-a4ee-b8611877af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:54.067290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 39/80] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:10:54.068130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.115153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.134605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 42/81] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:54.135690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e2cc3-ec68-4b28-a4ee-b8611877af04 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.166967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.170668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45aac7-2194-4e60-af44-0f564d9f35f5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.205618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.206293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.206591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.207191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.207649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:54.207963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.209362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.217472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 40/82] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:54.218266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.236132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e2cc3-ec68-4b28-a4ee-b8611877af04 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.270413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.271319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.271607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.271884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] PATH_INFO: `/v3/users/45390c2d5e85402a95796746fd244a1c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.273095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] RBAC: Authorizing `identity:get_user(user_id=45390c2d5e85402a95796746fd244a1c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.274557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.276228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 43/83] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/users/45390c2d5e85402a95796746fd244a1c => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:54.276987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.323934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa1d0d-7977-405b-9af9-e6ae7dd1851d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.325398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.357621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.358306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.358595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.358911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.375398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0e3b-85e4-46ba-8e37-a4c21e0c4395 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.386895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.409168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.410711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.411000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.411279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.412478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.413927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.415720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 44/84] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:54.416478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.432871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.434277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.518980 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc02d-9067-4cb1-b80d-a391daca7659 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.533478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 41/85] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:10:54.534323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.539379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.553711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.554509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.554840 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.555123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.556317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.557792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.559541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 45/86] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:54.560305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.598770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.639597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f751de-9cfb-4481-820f-672d06808497 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.659388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201a76-d421-4c61-93ca-34ef2c20b873 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.673755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.674635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.674953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.675272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.676486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.677966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.679702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 42/87] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:54.680464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.694300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.694922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.695237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.695521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.751293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.765548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.768065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.783617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084f6ec-dc7c-4fb1-b5e5-d95bfa2706e4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.810469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.819704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.820555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.820842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.821116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.821988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=c887c09296934553842076fabeae9c40, user.id=cf126c15be35403a9d3ba58ecc49d2b7) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:54.822319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.823812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.829286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 43/88] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/role_assignments?user.id=cf126c15be35403a9d3ba58ecc49d2b7&scope.project.id=c887c09296934553842076fabeae9c40&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:54.830060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.886895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 46/89] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:10:54.887784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:54.954429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075283d-94de-40b4-b572-5e8b19062cd9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:54.986689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:54.993395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:54.994271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:54.994561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:54.994889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:54.996113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:54.997581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:54.999648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 44/90] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:55.000420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:55.008489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1776-62a2-4b30-8e09-10612abc7d73 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:55.052058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:55.052752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:55.053040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:55.053321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:55.054046 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:55.055551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:55.063739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:55.103785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c7a7-656f-4da0-99e0-9bdcd8dc22d4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:55.138202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:55.138888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:55.139184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:55.139470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:55.141246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 47/91] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:10:54 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:10:55.141867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:55.224027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:55.225494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:55.282012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9a7f8-06ab-4dd8-adc4-d09ec583de63 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:55.305366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:55.324133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:55.326484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:55.326955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:55.327649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:55.329238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:55.332164 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:55.335021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 48/92] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:10:55 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:55.336173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:55.340622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 45/93] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:10:55.342744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:55.354715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:55.462586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdcf07-d484-4312-a670-b48aa1ba942a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:55.476593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04061db-1085-4c7f-a966-d0d4c14a2728 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:55.522122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:55.522974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:55.523260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:55.523543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:55.524392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] RBAC: Adding query filter params (role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=c887c09296934553842076fabeae9c40, user.id=cf126c15be35403a9d3ba58ecc49d2b7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:55.524711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:55.525480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:55.526152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:55.526253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:55.526442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:55.526757 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:55.527616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=c887c09296934553842076fabeae9c40, user.id=45390c2d5e85402a95796746fd244a1c) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:55.527935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:55.529391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:55.533053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 49/94] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:10:55 2022] GET /identity/v3/role_assignments?user.id=cf126c15be35403a9d3ba58ecc49d2b7&scope.project.id=c887c09296934553842076fabeae9c40&role.id=1a4d2011cce6457b9a1d4462800949db => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:55.533916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:55.544560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 46/95] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:10:55 2022] GET /identity/v3/role_assignments?user.id=45390c2d5e85402a95796746fd244a1c&scope.project.id=c887c09296934553842076fabeae9c40&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:55.640304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:55.670507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7b634-6b23-4510-b48f-4e189de47ca8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:55.714431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc388ab-095a-4b1b-8e89-94c68483a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:55.715389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc388ab-095a-4b1b-8e89-94c68483a08e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:55.715680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc388ab-095a-4b1b-8e89-94c68483a08e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:55.715964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc388ab-095a-4b1b-8e89-94c68483a08e None admin] PATH_INFO: `/v3/projects/5f087fd4b77a4ea4881ebed305b2300c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:55.717331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc388ab-095a-4b1b-8e89-94c68483a08e None admin] RBAC: Authorizing `identity:get_project(project_id=5f087fd4b77a4ea4881ebed305b2300c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:55.718868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc388ab-095a-4b1b-8e89-94c68483a08e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:55.720705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 50/96] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:10:55 2022] GET /identity/v3/projects/5f087fd4b77a4ea4881ebed305b2300c => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:55.727760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:55.759576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:55.845720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3595613-45bc-4fef-9946-0aa96e3d6982 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:55.912389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c42122-1def-4da1-983f-90aa46de8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:55.913066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42122-1def-4da1-983f-90aa46de8b2d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:55.913409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42122-1def-4da1-983f-90aa46de8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:55.913696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42122-1def-4da1-983f-90aa46de8b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:55.914554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c42122-1def-4da1-983f-90aa46de8b2d None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=5f087fd4b77a4ea4881ebed305b2300c, user.id=cf126c15be35403a9d3ba58ecc49d2b7) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:55.914902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c42122-1def-4da1-983f-90aa46de8b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:55.916396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c42122-1def-4da1-983f-90aa46de8b2d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:55.928147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 47/97] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:10:55 2022] GET /identity/v3/role_assignments?user.id=cf126c15be35403a9d3ba58ecc49d2b7&scope.project.id=5f087fd4b77a4ea4881ebed305b2300c&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:57.930403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64e3f-d559-4f51-9ce9-cb0ae534dff4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:57.930941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64e3f-d559-4f51-9ce9-cb0ae534dff4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:57.931016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa64e3f-d559-4f51-9ce9-cb0ae534dff4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:57.932642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 51/98] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:57.938182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510eb4-307b-4af3-a885-2646c2050a39 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:57.938625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510eb4-307b-4af3-a885-2646c2050a39 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:57.938856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41510eb4-307b-4af3-a885-2646c2050a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:57.963707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-41510eb4-307b-4af3-a885-2646c2050a39 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:57.964924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-41510eb4-307b-4af3-a885-2646c2050a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:58.035738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fddb2-a5fb-46fe-809b-23519a07e4ea None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.036059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fddb2-a5fb-46fe-809b-23519a07e4ea None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.036303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fddb2-a5fb-46fe-809b-23519a07e4ea None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.037935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 52/99] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:58.048066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98428ca-471a-4d2c-978b-c5eb3fbeb26c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.048372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98428ca-471a-4d2c-978b-c5eb3fbeb26c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.048629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98428ca-471a-4d2c-978b-c5eb3fbeb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.079756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d98428ca-471a-4d2c-978b-c5eb3fbeb26c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:58.080991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d98428ca-471a-4d2c-978b-c5eb3fbeb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:58.096417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 48/100] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:10:58.134296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510eb4-307b-4af3-a885-2646c2050a39 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:58.171744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:58.196193 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 53/101] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 15:10:58.234927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98428ca-471a-4d2c-978b-c5eb3fbeb26c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:58.328510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41510eb4-307b-4af3-a885-2646c2050a39 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:58.368389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:58.399718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:58.400587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.400877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.401152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.402356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:58.404698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:58.406350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 49/102] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:58.417149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:58.432186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98428ca-471a-4d2c-978b-c5eb3fbeb26c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:58.489400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b821b2c-fc85-4bf5-b586-8797fd3e1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:58.499991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b821b2c-fc85-4bf5-b586-8797fd3e1929 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.500398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b821b2c-fc85-4bf5-b586-8797fd3e1929 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.500692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b821b2c-fc85-4bf5-b586-8797fd3e1929 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.519111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b821b2c-fc85-4bf5-b586-8797fd3e1929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6b821b2c-fc85-4bf5-b586-8797fd3e1929 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:58.527530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:58.528497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:58.529286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 54/103] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:10:58.530756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168c78-83cb-4175-af8a-15363502ceb7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.531128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168c78-83cb-4175-af8a-15363502ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.531568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168c78-83cb-4175-af8a-15363502ceb7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.533095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 55/104] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:58.535024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168c78-83cb-4175-af8a-15363502ceb7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:58.560139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:58.575915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813482a6-662d-40be-ab02-2a4cbbc9f3c1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:58.627033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ac441-f282-4d6c-8f65-161705f0b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:58.630812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac441-f282-4d6c-8f65-161705f0b3b4 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.631163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac441-f282-4d6c-8f65-161705f0b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.631449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac441-f282-4d6c-8f65-161705f0b3b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.632191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ac441-f282-4d6c-8f65-161705f0b3b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:58.633653 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ac441-f282-4d6c-8f65-161705f0b3b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:58.679888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168c78-83cb-4175-af8a-15363502ceb7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:58.709541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:58.714838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df0474-fcb2-4cae-ac45-a2b2ba93dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:58.715638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df0474-fcb2-4cae-ac45-a2b2ba93dc8a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.715932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df0474-fcb2-4cae-ac45-a2b2ba93dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.716221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df0474-fcb2-4cae-ac45-a2b2ba93dc8a None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.716978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df0474-fcb2-4cae-ac45-a2b2ba93dc8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:58.717292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df0474-fcb2-4cae-ac45-a2b2ba93dc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:58.718848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df0474-fcb2-4cae-ac45-a2b2ba93dc8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:58.721075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 50/105] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:10:58 2022] POST /identity/v3/projects => generated 302 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:10:58.730894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 56/106] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:10:58.730894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c78c8c-df3c-48e5-bd51-c81d4062f3bc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.730894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c78c8c-df3c-48e5-bd51-c81d4062f3bc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.731192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c78c8c-df3c-48e5-bd51-c81d4062f3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.732931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df6cb-b3ee-43ba-81e5-7fce5f14e009 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.733374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df6cb-b3ee-43ba-81e5-7fce5f14e009 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.733656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df6cb-b3ee-43ba-81e5-7fce5f14e009 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.735278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 51/107] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:58.736545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406202a7-95df-42c9-a344-e5cf0ac68d55 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.737023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406202a7-95df-42c9-a344-e5cf0ac68d55 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.737491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406202a7-95df-42c9-a344-e5cf0ac68d55 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.757733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 52/108] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:58.757733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406202a7-95df-42c9-a344-e5cf0ac68d55 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:58.758003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-06c78c8c-df3c-48e5-bd51-c81d4062f3bc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:58.758003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-06c78c8c-df3c-48e5-bd51-c81d4062f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:58.842927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 57/109] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:58.844738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc8f06-da52-42e7-b8cd-1dc4f968087b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:58.845216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc8f06-da52-42e7-b8cd-1dc4f968087b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:58.845728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc8f06-da52-42e7-b8cd-1dc4f968087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:58.964570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-aefc8f06-da52-42e7-b8cd-1dc4f968087b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:58.966656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aefc8f06-da52-42e7-b8cd-1dc4f968087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:58.992412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406202a7-95df-42c9-a344-e5cf0ac68d55 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.040588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718c186-5fcf-41cc-9f3a-8c4065482ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.042162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718c186-5fcf-41cc-9f3a-8c4065482ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.042826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718c186-5fcf-41cc-9f3a-8c4065482ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.043440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718c186-5fcf-41cc-9f3a-8c4065482ef9 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.045056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718c186-5fcf-41cc-9f3a-8c4065482ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:59.047305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718c186-5fcf-41cc-9f3a-8c4065482ef9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:59.049894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 53/110] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:58 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:59.052085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c87e3-30a0-41f4-ba1c-7c8dfef1d995 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.052591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c87e3-30a0-41f4-ba1c-7c8dfef1d995 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.053091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c87e3-30a0-41f4-ba1c-7c8dfef1d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.063202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 58/111] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:59.064390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc8f06-da52-42e7-b8cd-1dc4f968087b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.078742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.088127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7a3c87e3-30a0-41f4-ba1c-7c8dfef1d995 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:59.089169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7a3c87e3-30a0-41f4-ba1c-7c8dfef1d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:59.135760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.163028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 54/112] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:59.170516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c87e3-30a0-41f4-ba1c-7c8dfef1d995 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.185631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc8f06-da52-42e7-b8cd-1dc4f968087b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.221999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.223521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.223810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.224092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.238202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:59.246476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:59.247437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:59.248253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 59/113] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:59.248929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.288802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c87e3-30a0-41f4-ba1c-7c8dfef1d995 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.323943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394c9b3-c197-448f-bd6b-85715b52a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.324733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394c9b3-c197-448f-bd6b-85715b52a2dd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.325022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394c9b3-c197-448f-bd6b-85715b52a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.325308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394c9b3-c197-448f-bd6b-85715b52a2dd None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.326506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394c9b3-c197-448f-bd6b-85715b52a2dd None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:59.328008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394c9b3-c197-448f-bd6b-85715b52a2dd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:59.333785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 55/114] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:59.333785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53411e-2db0-49a1-a8d9-b05de1dcbbe8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.333785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53411e-2db0-49a1-a8d9-b05de1dcbbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.333785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53411e-2db0-49a1-a8d9-b05de1dcbbe8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.333785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 56/115] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:10:59.338296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53411e-2db0-49a1-a8d9-b05de1dcbbe8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.341933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.368308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ec34-e998-46ad-8c51-557c5e46b104 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.382292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.406283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.407151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.407435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.407705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.420724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:59.428632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:59.429516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 60/116] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:59.435522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.460126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53411e-2db0-49a1-a8d9-b05de1dcbbe8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.496786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.497751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.498041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.498321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.513742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:10:59.521936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:10:59.522844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:10:59.523630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 57/117] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:10:59.525650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.546479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e6e1-2952-4ef6-b439-185546af608b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.586334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399cd32-953a-4c49-a631-55499caf52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.587149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399cd32-953a-4c49-a631-55499caf52e7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.587446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399cd32-953a-4c49-a631-55499caf52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.587731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399cd32-953a-4c49-a631-55499caf52e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.588486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399cd32-953a-4c49-a631-55499caf52e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:59.588969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399cd32-953a-4c49-a631-55499caf52e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:59.590201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399cd32-953a-4c49-a631-55499caf52e7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:59.592711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.598605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 61/118] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:59.604607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281dc8f-415f-4f75-9d1c-2b0188171fd9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.604910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281dc8f-415f-4f75-9d1c-2b0188171fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.605196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281dc8f-415f-4f75-9d1c-2b0188171fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.622339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b281dc8f-415f-4f75-9d1c-2b0188171fd9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:10:59.624732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b281dc8f-415f-4f75-9d1c-2b0188171fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:10:59.645349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b2b77-88b7-468d-be20-96fb4330baf9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.661840 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.683146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.684359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.684648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.685084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40/users/cf126c15be35403a9d3ba58ecc49d2b7/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.688025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] RBAC: Authorizing `identity:create_grant(project_id=c887c09296934553842076fabeae9c40, user_id=cf126c15be35403a9d3ba58ecc49d2b7, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:59.689660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:59.703458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 62/119] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:10:59.704301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281dc8f-415f-4f75-9d1c-2b0188171fd9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.753073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 58/120] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:10:59 2022] PUT /identity/v3/projects/c887c09296934553842076fabeae9c40/users/cf126c15be35403a9d3ba58ecc49d2b7/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:10:59.755064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.821826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281dc8f-415f-4f75-9d1c-2b0188171fd9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.863071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.863875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.864241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.864600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.865387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:59.865703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:59.867154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:59.876568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 63/121] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:59.882211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:10:59.893615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823e9d-d043-486e-968a-5ca660dd3778 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:10:59.919704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.931446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:10:59.944449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:10:59.949501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:10:59.949501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:10:59.949501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:10:59.949501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:10:59.949501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:10:59.949501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:10:59.959060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 59/122] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:10:59.959903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.010609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292e736-f899-49e6-944f-a0620fa0233b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.062673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.064280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.064868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.065559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.067815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.071245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.077595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eea7cb-7ca1-4499-ab50-dcb2983e07b7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.079184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 64/123] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:00.080655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.123916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.124638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.124927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.125367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.139412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:00.151497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:00.152538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:00.153806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 60/124] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:00.155189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.202826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:00.211458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c3ba-257b-487d-86bb-8c252faa0f55 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.220750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:00.257762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.258951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.259733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.260403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] PATH_INFO: `/v3/users/45390c2d5e85402a95796746fd244a1c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.261758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] RBAC: Authorizing `identity:get_user(user_id=45390c2d5e85402a95796746fd244a1c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.263939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.266668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 65/125] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:00 2022] GET /identity/v3/users/45390c2d5e85402a95796746fd244a1c => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:00.267630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.292994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b667a0-0aa4-4dd5-a33c-eadc21419263 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.335174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.336545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.336968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.337646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] PATH_INFO: `/v3/users/7c4c0640cb5a4b6295f94b2125629c1a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.356416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] RBAC: Authorizing `identity:get_user(user_id=7c4c0640cb5a4b6295f94b2125629c1a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.358854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.361542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 61/126] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:00 2022] GET /identity/v3/users/7c4c0640cb5a4b6295f94b2125629c1a => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:00.362453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.408049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d94503-698a-4d32-8a62-5dc80b0a9de5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.455035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.456991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.458001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.458490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.459976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.461884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.464288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 66/127] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:00 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:00.465386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.485682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738ebdb-1c8c-494d-ad93-1d90ca4bd1ca None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.489463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:00.506758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:00.524455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.525774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.526430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.527233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.528379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:00.528694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.530337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.541826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 62/128] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:00.543069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.592635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772ccf3-8c99-4fae-ac89-b23ded787eeb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.631022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.632397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.632935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.633461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.635178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.637108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.639126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 67/129] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:00 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:00.644760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.673476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9ec23-c052-4ace-986d-49e5ffb5b997 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.716458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.717122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.717395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.717676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.752648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:00.756225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:00.760202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc784a5-dcfa-4bee-85e1-6010c3b6b1f2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:00.790685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.792180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.797414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:00.798567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:00.799225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:00.799791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40/users/cf126c15be35403a9d3ba58ecc49d2b7/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:00.802896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] RBAC: Authorizing `identity:create_grant(project_id=c887c09296934553842076fabeae9c40, user_id=cf126c15be35403a9d3ba58ecc49d2b7, role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:00.805835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:00.897903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 63/130] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:00.902731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.912750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 68/131] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:00 2022] PUT /identity/v3/projects/c887c09296934553842076fabeae9c40/users/cf126c15be35403a9d3ba58ecc49d2b7/roles/1a4d2011cce6457b9a1d4462800949db => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:00.914297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:00.997055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:01.040089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f9047-1a63-4a76-92cd-0abb2ca0a70b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.040652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99cf33-a8fc-473d-b5e2-c18ef6b7633e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.079706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039ad5-b390-4c6f-a213-b82f6ba5f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.081148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039ad5-b390-4c6f-a213-b82f6ba5f9e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.082202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.082871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039ad5-b390-4c6f-a213-b82f6ba5f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.083347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039ad5-b390-4c6f-a213-b82f6ba5f9e9 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40/users/45390c2d5e85402a95796746fd244a1c/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.083465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.083725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.084016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.085305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.086436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039ad5-b390-4c6f-a213-b82f6ba5f9e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c887c09296934553842076fabeae9c40, user_id=45390c2d5e85402a95796746fd244a1c, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.086886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:01.088565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039ad5-b390-4c6f-a213-b82f6ba5f9e9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:01.089065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 64/132] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:00 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:01.089905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:01.170752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 69/133] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:00 2022] PUT /identity/v3/projects/c887c09296934553842076fabeae9c40/users/45390c2d5e85402a95796746fd244a1c/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:01.176930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005215af-0bc7-4274-a0e3-3bab5edaeff9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.177224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005215af-0bc7-4274-a0e3-3bab5edaeff9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.177507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005215af-0bc7-4274-a0e3-3bab5edaeff9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.178954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 70/134] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:01.183868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005215af-0bc7-4274-a0e3-3bab5edaeff9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:01.209620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21fb06-1933-48ce-83d1-1b01054281a9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.226631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:01.253222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f2c60-395a-491b-bfc3-5f42a764c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.253993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2c60-395a-491b-bfc3-5f42a764c35a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.254290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2c60-395a-491b-bfc3-5f42a764c35a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.254569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f2c60-395a-491b-bfc3-5f42a764c35a None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.256832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f2c60-395a-491b-bfc3-5f42a764c35a None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.258329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f2c60-395a-491b-bfc3-5f42a764c35a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:01.260546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 65/135] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:01 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:01.261647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822b3d-c6c6-4b42-8621-dc57ed094f06 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.261881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822b3d-c6c6-4b42-8621-dc57ed094f06 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.262169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822b3d-c6c6-4b42-8621-dc57ed094f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.267686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:01.282734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-07822b3d-c6c6-4b42-8621-dc57ed094f06 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:01.284330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-07822b3d-c6c6-4b42-8621-dc57ed094f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:01.377083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 66/136] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:01.379056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822b3d-c6c6-4b42-8621-dc57ed094f06 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:01.403701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005215af-0bc7-4274-a0e3-3bab5edaeff9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.457067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.458306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.458826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.459327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] PATH_INFO: `/v3/projects/5f087fd4b77a4ea4881ebed305b2300c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.460770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] RBAC: Authorizing `identity:get_project(project_id=5f087fd4b77a4ea4881ebed305b2300c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.462427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:01.464420 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 71/137] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:01 2022] GET /identity/v3/projects/5f087fd4b77a4ea4881ebed305b2300c => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:01.465400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:01.541123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822b3d-c6c6-4b42-8621-dc57ed094f06 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.593674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.594709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.595198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.595962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.597904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] RBAC: Adding query filter params (role.id=07579953b0b047439d17ec419622f802, scope.project.id=c887c09296934553842076fabeae9c40, user.id=7c4c0640cb5a4b6295f94b2125629c1a) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:01.598431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.600148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:01.606540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 67/138] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:01 2022] GET /identity/v3/role_assignments?user.id=7c4c0640cb5a4b6295f94b2125629c1a&scope.project.id=c887c09296934553842076fabeae9c40&role.id=07579953b0b047439d17ec419622f802 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:01.610886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:01.612029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:01.630526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:01.658979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942519b-eec3-42e7-be21-b202f7498dff None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.739519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.740359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.740653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.740937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.742314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.743870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:01.745957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 72/139] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:01.751406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:01.799063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6330c1-66dc-40a5-8dea-79f7375b985e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.875368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b72b-4b2c-4669-bbeb-1ae70e325c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.876287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b72b-4b2c-4669-bbeb-1ae70e325c89 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.876682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b72b-4b2c-4669-bbeb-1ae70e325c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.876969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b72b-4b2c-4669-bbeb-1ae70e325c89 None admin] PATH_INFO: `/v3/projects/5f087fd4b77a4ea4881ebed305b2300c/users/cf126c15be35403a9d3ba58ecc49d2b7/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.880094 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500b72b-4b2c-4669-bbeb-1ae70e325c89 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f087fd4b77a4ea4881ebed305b2300c, user_id=cf126c15be35403a9d3ba58ecc49d2b7, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.881589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500b72b-4b2c-4669-bbeb-1ae70e325c89 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:01.928887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6287946-47bb-4387-8772-7feadfca8381 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:01.975792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 68/140] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:01 2022] PUT /identity/v3/projects/5f087fd4b77a4ea4881ebed305b2300c/users/cf126c15be35403a9d3ba58ecc49d2b7/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:01.979442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c7bd-d346-4961-9564-d84891ebe8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:01.980201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c7bd-d346-4961-9564-d84891ebe8c9 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:01.980545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c7bd-d346-4961-9564-d84891ebe8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:01.980943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c7bd-d346-4961-9564-d84891ebe8c9 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:01.981841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c7bd-d346-4961-9564-d84891ebe8c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:01.983494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c7bd-d346-4961-9564-d84891ebe8c9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:02.085672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 73/141] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:01 2022] POST /identity/v3/users => generated 283 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:11:02.158376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95b6b5-d10c-43d0-9a48-5017ce5276f9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:02.158919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95b6b5-d10c-43d0-9a48-5017ce5276f9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:02.159027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95b6b5-d10c-43d0-9a48-5017ce5276f9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:02.161824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 69/142] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:02.167975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887ff0c-ae84-402f-9445-a58acb56f94e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:02.168264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887ff0c-ae84-402f-9445-a58acb56f94e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:02.168553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887ff0c-ae84-402f-9445-a58acb56f94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:02.188481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3887ff0c-ae84-402f-9445-a58acb56f94e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:02.189830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3887ff0c-ae84-402f-9445-a58acb56f94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:02.200370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:02.281481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 74/143] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:02.325241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95b6b5-d10c-43d0-9a48-5017ce5276f9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:02.401051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:02.450375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95b6b5-d10c-43d0-9a48-5017ce5276f9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:02.493048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:02.493048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:02.493048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:02.493048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:02.515981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:02.524798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:02.525692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:02.526487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 70/144] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:02.536027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887ff0c-ae84-402f-9445-a58acb56f94e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:02.666725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887ff0c-ae84-402f-9445-a58acb56f94e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:02.712789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:02.713489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:02.713781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:02.714065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:02.714871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:02.715186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:02.716581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:02.726258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 75/145] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:02.731824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:02.893921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dcf22-ff2a-4e35-b1d8-c5020fe70db5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:02.923070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:02.934357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:02.935265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:02.935548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:02.940177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:02.940177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:02.940177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:02.940177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 71/146] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:02 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:02.946669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:02.951871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:03.079398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d117c8-0f49-4451-91d4-333d4670b46f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:03.142687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984aec-01bf-45f3-9b8d-5ce55e10978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:03.142687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984aec-01bf-45f3-9b8d-5ce55e10978a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:03.142687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984aec-01bf-45f3-9b8d-5ce55e10978a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:03.142687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984aec-01bf-45f3-9b8d-5ce55e10978a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:03.211884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984aec-01bf-45f3-9b8d-5ce55e10978a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:03.213386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984aec-01bf-45f3-9b8d-5ce55e10978a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:03.216758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:03.328540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 76/147] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:03.339929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:03.406355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786b64-783b-4398-bfc3-83d806d3101f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:03.406714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786b64-783b-4398-bfc3-83d806d3101f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:03.406944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e786b64-783b-4398-bfc3-83d806d3101f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:03.408349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 77/148] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:03.413842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5994-35e8-4681-915b-45d056e89e7a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:03.414135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5994-35e8-4681-915b-45d056e89e7a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:03.414423 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe5994-35e8-4681-915b-45d056e89e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:03.443803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8fbe5994-35e8-4681-915b-45d056e89e7a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:03.445004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8fbe5994-35e8-4681-915b-45d056e89e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:03.500668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec29a5-8690-4105-a41a-ef5979174461 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:03.564188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 78/149] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:03.565091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:03.566985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:03.567487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:03.567772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:03.575417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:03.576907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:03.578687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 72/150] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:03 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:03.584719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe5994-35e8-4681-915b-45d056e89e7a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:03.609566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:03.639117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:03.691382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:03.756275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17012-e645-4da6-b82a-f2c2bb0035a5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:03.774444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe5994-35e8-4681-915b-45d056e89e7a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:03.804721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:03.806804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:03.806804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:03.806804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:03.828305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:03.841679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:03.844096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:03.844907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 73/151] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:03.854173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:03.861562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:03.862244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:03.862564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:03.862919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:03.863735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=c887c09296934553842076fabeae9c40, user.id=cf126c15be35403a9d3ba58ecc49d2b7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:03.864052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:03.865526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:03.879852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 79/152] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:03 2022] GET /identity/v3/role_assignments?user.id=cf126c15be35403a9d3ba58ecc49d2b7&scope.project.id=c887c09296934553842076fabeae9c40&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:03.999845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fe806-843a-439e-9b2f-c11dce1f5df2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:04.015698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:04.044178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:04.044856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:04.045137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:04.045410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:04.046169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:04.046472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:04.047888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:04.058732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 74/153] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:04.064424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:04.205287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:04.209459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed6db4-de9b-4e88-a1e5-daddd27bf6a7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:04.254495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123dc0-4b02-426c-9844-b3dae27407f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:04.255419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123dc0-4b02-426c-9844-b3dae27407f9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:04.255763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123dc0-4b02-426c-9844-b3dae27407f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:04.256045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123dc0-4b02-426c-9844-b3dae27407f9 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:04.259369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123dc0-4b02-426c-9844-b3dae27407f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:04.261072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123dc0-4b02-426c-9844-b3dae27407f9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:04.263050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 80/154] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:04 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:04.268680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:04.311483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5125-f5a8-4c6d-8b46-67d066348789 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:04.311823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5125-f5a8-4c6d-8b46-67d066348789 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:04.312050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5125-f5a8-4c6d-8b46-67d066348789 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:04.313687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 81/155] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:04.318722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6f3c-78ee-417d-97c1-171d91d0f1fa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:04.319015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6f3c-78ee-417d-97c1-171d91d0f1fa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:04.319298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef6f3c-78ee-417d-97c1-171d91d0f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:04.355725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8bef6f3c-78ee-417d-97c1-171d91d0f1fa None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:04.356947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8bef6f3c-78ee-417d-97c1-171d91d0f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:04.428939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40e8a8-fe05-4002-acc5-93743e968c4a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:04.512863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:04.513810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:04.514299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:04.514848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:04.540135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 82/156] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:04.576742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef6f3c-78ee-417d-97c1-171d91d0f1fa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:04.587265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:04.624370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:04.625858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:04.816852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:04.826693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef6f3c-78ee-417d-97c1-171d91d0f1fa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:04.837734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 75/157] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:04.843294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:04.910799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:04.911674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:04.911970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:04.912252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:04.942662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:04.950572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:04.951475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:04.952333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 83/158] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:04.960853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:04.968562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:05.019865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492fa3-e650-4c97-886c-6ddc0305db5f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:05.083623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:05.084700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.084991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.085268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.087335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:05.089006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:05.091441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 76/159] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:04 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:05.098347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:05.194713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163472-e8a1-4faa-973e-847cc19318b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:05.270398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257350-c8d8-4364-af4b-38b0eaf5af58 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:05.272030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82515b-3adf-4b26-9939-c5715aa38afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:05.273343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82515b-3adf-4b26-9939-c5715aa38afb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.273823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82515b-3adf-4b26-9939-c5715aa38afb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.274302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82515b-3adf-4b26-9939-c5715aa38afb None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.275298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82515b-3adf-4b26-9939-c5715aa38afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:05.275833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82515b-3adf-4b26-9939-c5715aa38afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:05.277413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82515b-3adf-4b26-9939-c5715aa38afb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:05.292807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 84/160] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:05.294500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b43b-294a-47cf-835d-af34d5d868bb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.295008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b43b-294a-47cf-835d-af34d5d868bb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.295490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b43b-294a-47cf-835d-af34d5d868bb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.300235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 85/161] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:05.305655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0d7d-b4d8-409d-88a0-e72681fda2fc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.306194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0d7d-b4d8-409d-88a0-e72681fda2fc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.306684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0d7d-b4d8-409d-88a0-e72681fda2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.320289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:05.325993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.326476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.326960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.327992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] RBAC: Adding query filter params (role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=c887c09296934553842076fabeae9c40, user.id=cf126c15be35403a9d3ba58ecc49d2b7) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:05.328498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:05.330177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:05.347836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 77/162] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:05 2022] GET /identity/v3/role_assignments?user.id=cf126c15be35403a9d3ba58ecc49d2b7&scope.project.id=c887c09296934553842076fabeae9c40&role.id=1a4d2011cce6457b9a1d4462800949db => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:05.349138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:05.350307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-14cc0d7d-b4d8-409d-88a0-e72681fda2fc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:05.352169 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-14cc0d7d-b4d8-409d-88a0-e72681fda2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:05.364043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:05.387022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:05.544352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 86/163] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:05.578966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0d7d-b4d8-409d-88a0-e72681fda2fc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:05.613110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0de306-6572-42f6-b2f7-ed4c6d2ef769 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:05.715387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:05.716265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.716547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.716819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] PATH_INFO: `/v3/users/45390c2d5e85402a95796746fd244a1c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.718075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] RBAC: Authorizing `identity:get_user(user_id=45390c2d5e85402a95796746fd244a1c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:05.719563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:05.721389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 78/164] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:05 2022] GET /identity/v3/users/45390c2d5e85402a95796746fd244a1c => generated 247 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:05.727732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:05.841338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0d7d-b4d8-409d-88a0-e72681fda2fc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:05.880248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:05.905048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3a6be-8567-4c10-bb8f-e89ae8e04931 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:05.944330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7e9f1-d70c-40a0-908f-03d1f0fc372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:05.945152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e9f1-d70c-40a0-908f-03d1f0fc372e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.945477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e9f1-d70c-40a0-908f-03d1f0fc372e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.945711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e9f1-d70c-40a0-908f-03d1f0fc372e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.953352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:05.955166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.957921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.958454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.975943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7e9f1-d70c-40a0-908f-03d1f0fc372e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-47c7e9f1-d70c-40a0-908f-03d1f0fc372e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:05.986752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:05.987702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:05.988676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:05.991377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 87/165] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:05.993190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625a53-34f3-4f59-9be9-96c4278991a9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:05.993694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625a53-34f3-4f59-9be9-96c4278991a9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:05.994185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625a53-34f3-4f59-9be9-96c4278991a9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:05.997748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 88/166] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:05.998813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625a53-34f3-4f59-9be9-96c4278991a9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.016109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:06.125406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625a53-34f3-4f59-9be9-96c4278991a9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:06.146071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:06.147546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:06.166168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bb6b7-1aba-4e7c-b579-60720a9f7e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:06.167216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb6b7-1aba-4e7c-b579-60720a9f7e48 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.167824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb6b7-1aba-4e7c-b579-60720a9f7e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.168322 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bb6b7-1aba-4e7c-b579-60720a9f7e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.169272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb6b7-1aba-4e7c-b579-60720a9f7e48 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:06.169800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb6b7-1aba-4e7c-b579-60720a9f7e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:06.171557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bb6b7-1aba-4e7c-b579-60720a9f7e48 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:06.181469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 89/167] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:06.182969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b05fc0-29a6-4fc2-96d0-545b601ff422 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.183465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b05fc0-29a6-4fc2-96d0-545b601ff422 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.184228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b05fc0-29a6-4fc2-96d0-545b601ff422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.203627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-20b05fc0-29a6-4fc2-96d0-545b601ff422 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:06.205361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-20b05fc0-29a6-4fc2-96d0-545b601ff422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:06.279414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:06.282856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 90/168] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:06.283965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b05fc0-29a6-4fc2-96d0-545b601ff422 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.335088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:06.417075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b05fc0-29a6-4fc2-96d0-545b601ff422 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:06.421237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 79/169] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:11:06.422172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.459210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:06.460319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.460667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.461020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] PATH_INFO: `/v3/users/7c4c0640cb5a4b6295f94b2125629c1a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.462333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] RBAC: Authorizing `identity:get_user(user_id=7c4c0640cb5a4b6295f94b2125629c1a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:06.463903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:06.465661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 91/170] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:06 2022] GET /identity/v3/users/7c4c0640cb5a4b6295f94b2125629c1a => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:06.466505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.544828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:06.573877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8610bcb-e794-42e9-81ba-798a5f11181f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:06.583724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65029f-edff-40a5-882e-39ac4485a014 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:06.609853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:06.610671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.610967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.611244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.621839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:06.624341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843950b-63ae-42e3-8a1b-b42f79873f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:06.625483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843950b-63ae-42e3-8a1b-b42f79873f3c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.625969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843950b-63ae-42e3-8a1b-b42f79873f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.626447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843950b-63ae-42e3-8a1b-b42f79873f3c None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.627895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843950b-63ae-42e3-8a1b-b42f79873f3c None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:06.629744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:06.630612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:06.631460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 80/171] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:06.632208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.637673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843950b-63ae-42e3-8a1b-b42f79873f3c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:06.640006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 92/172] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:06 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:06.641395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369cfad-8973-4fba-9471-0d30b9a9cd3b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.641832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369cfad-8973-4fba-9471-0d30b9a9cd3b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.642259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369cfad-8973-4fba-9471-0d30b9a9cd3b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.646687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 93/173] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:06.650296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369cfad-8973-4fba-9471-0d30b9a9cd3b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.691467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:06.736731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67833a-de51-4225-815c-c4cb163d418b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:06.760686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369cfad-8973-4fba-9471-0d30b9a9cd3b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:06.772642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd54b7-5b30-4f79-8eb4-77abe62b3815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:06.773699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd54b7-5b30-4f79-8eb4-77abe62b3815 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.774086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd54b7-5b30-4f79-8eb4-77abe62b3815 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.774464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd54b7-5b30-4f79-8eb4-77abe62b3815 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.775836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd54b7-5b30-4f79-8eb4-77abe62b3815 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:06.777562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd54b7-5b30-4f79-8eb4-77abe62b3815 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:06.782904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 81/174] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:06 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:06.784256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547b92-911b-4cc9-aaf4-189b3479a49f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.785187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547b92-911b-4cc9-aaf4-189b3479a49f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.785618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547b92-911b-4cc9-aaf4-189b3479a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.802484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:06.803209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.803560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.803844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.804609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:06.804922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:06.805586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d6547b92-911b-4cc9-aaf4-189b3479a49f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:06.806326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:06.807084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d6547b92-911b-4cc9-aaf4-189b3479a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:06.808876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:06.817753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 94/175] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:06.819219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.912833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 82/176] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:06.913862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547b92-911b-4cc9-aaf4-189b3479a49f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:06.930873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4212-2cda-4495-995d-ffef604cbc42 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:06.952494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:06.968485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:06.969154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:06.969435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:06.969833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:06.970556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=c887c09296934553842076fabeae9c40, user.id=45390c2d5e85402a95796746fd244a1c) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:06.970923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:06.972509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:06.978579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 95/177] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:06 2022] GET /identity/v3/role_assignments?user.id=45390c2d5e85402a95796746fd244a1c&scope.project.id=c887c09296934553842076fabeae9c40&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:06.979374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.057090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547b92-911b-4cc9-aaf4-189b3479a49f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.059589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:07.098158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c7fd5-d561-4633-b6ae-28360d0194c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.099160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c7fd5-d561-4633-b6ae-28360d0194c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.099721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c7fd5-d561-4633-b6ae-28360d0194c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.099721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c7fd5-d561-4633-b6ae-28360d0194c0 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40/users/7c4c0640cb5a4b6295f94b2125629c1a/roles/07579953b0b047439d17ec419622f802` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.101741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c7fd5-d561-4633-b6ae-28360d0194c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c887c09296934553842076fabeae9c40, user_id=7c4c0640cb5a4b6295f94b2125629c1a, role_id=07579953b0b047439d17ec419622f802)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:07.102798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65f801-bac8-4bdd-8540-01c806695417 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.103247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c7fd5-d561-4633-b6ae-28360d0194c0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:07.140141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.141046 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.141332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.141607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] PATH_INFO: `/v3/users/cf126c15be35403a9d3ba58ecc49d2b7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.142859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=cf126c15be35403a9d3ba58ecc49d2b7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:07.144411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:07.146530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 96/178] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:06 2022] GET /identity/v3/users/cf126c15be35403a9d3ba58ecc49d2b7 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:07.146848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.185038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 83/179] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:06 2022] PUT /identity/v3/projects/c887c09296934553842076fabeae9c40/users/7c4c0640cb5a4b6295f94b2125629c1a/roles/07579953b0b047439d17ec419622f802 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:07.186387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb16e-ab7a-4258-b708-78bffb4e4432 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.186754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb16e-ab7a-4258-b708-78bffb4e4432 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.187375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fb16e-ab7a-4258-b708-78bffb4e4432 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.188483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 84/180] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:07.192441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f61d-8e46-4d28-8313-2ce4bfbae4b0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.201321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f61d-8e46-4d28-8313-2ce4bfbae4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.201321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f61d-8e46-4d28-8313-2ce4bfbae4b0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.201321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 85/181] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:07.201321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f61d-8e46-4d28-8313-2ce4bfbae4b0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.272994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e962f1-c49d-4e5c-97b0-e50e8d32fcb6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.310932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:07.317575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeda27-e6ab-477b-817e-74bebe8a58e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.318388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeda27-e6ab-477b-817e-74bebe8a58e4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.318708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeda27-e6ab-477b-817e-74bebe8a58e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.318993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeda27-e6ab-477b-817e-74bebe8a58e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.323822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:07.333252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeda27-e6ab-477b-817e-74bebe8a58e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:07.334454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f61d-8e46-4d28-8313-2ce4bfbae4b0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-acfeda27-e6ab-477b-817e-74bebe8a58e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:07.342271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:07.343430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:07.344312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 97/182] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:07.348866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dca3ae-4999-4a59-babd-bbd0680eaf07 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.349740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dca3ae-4999-4a59-babd-bbd0680eaf07 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.350737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dca3ae-4999-4a59-babd-bbd0680eaf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.370689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f4dca3ae-4999-4a59-babd-bbd0680eaf07 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:07.371869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f4dca3ae-4999-4a59-babd-bbd0680eaf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:07.378835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d883d01-2635-4584-9179-874a6387239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.379597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883d01-2635-4584-9179-874a6387239a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.379823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883d01-2635-4584-9179-874a6387239a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.380105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d883d01-2635-4584-9179-874a6387239a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.447484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 98/183] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:07.453818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d883d01-2635-4584-9179-874a6387239a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:07.455429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d883d01-2635-4584-9179-874a6387239a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:07.455994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e03de-98ca-4abe-990b-9e64e8e2718b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.456333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e03de-98ca-4abe-990b-9e64e8e2718b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.456614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e03de-98ca-4abe-990b-9e64e8e2718b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.481429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4a6e03de-98ca-4abe-990b-9e64e8e2718b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:07.482729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a6e03de-98ca-4abe-990b-9e64e8e2718b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:07.556896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 99/184] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:07.557715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e03de-98ca-4abe-990b-9e64e8e2718b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.573247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:07.583926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 86/185] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:07.584944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d883d01-2635-4584-9179-874a6387239a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.623039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:07.680853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e03de-98ca-4abe-990b-9e64e8e2718b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.688827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d883d01-2635-4584-9179-874a6387239a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.719782 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.720471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.720757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.721036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.721832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:07.722343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:07.723819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:07.725241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.725943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.726227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.726501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.733279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 100/186] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:07.734368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.742545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:07.750561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:07.751584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:07.752480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 87/187] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:07.753729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.810753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:07.851806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3ba94-83ad-49e7-a80f-ce784f154f31 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.864609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfe570-ec12-4250-9843-3b2dcdd5f208 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:07.865760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:07.889560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.890381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.891008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.891525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.893131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:07.895901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:07.897558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 101/188] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:07.898317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:07.906006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:07.906915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:07.907199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:07.907473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] PATH_INFO: `/v3/projects/5f087fd4b77a4ea4881ebed305b2300c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:07.909120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] RBAC: Authorizing `identity:get_project(project_id=5f087fd4b77a4ea4881ebed305b2300c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:07.911704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:07.913752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 88/189] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/projects/5f087fd4b77a4ea4881ebed305b2300c => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:07.919164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.007170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f92500-ef3c-4b96-af30-0e211f263407 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.026071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c3db-a924-460f-9c80-4d60ff54104e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.042551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.043464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.043747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.044026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] PATH_INFO: `/v3/users/fead379928ec48bd8668a1285a3dd831` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.048553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:08.060595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] RBAC: Authorizing `identity:get_user(user_id=fead379928ec48bd8668a1285a3dd831)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.062825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.063922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 102/190] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/users/fead379928ec48bd8668a1285a3dd831 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:08.064668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.069005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.069361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.069650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.069931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.070960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:08.071273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.072655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.082571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 89/191] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:08.083237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.113919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:08.177733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c48108-5c76-4826-a0cc-e7695cd23edb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.188562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3603-1ef8-45cf-8262-d6a4d2b362a2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.215423 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.216096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.216379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.216656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.217528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.219176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.222906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.223531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.223814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.224088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.224917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=5f087fd4b77a4ea4881ebed305b2300c, user.id=cf126c15be35403a9d3ba58ecc49d2b7) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:08.225228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.226679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.233217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 90/192] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:08 2022] GET /identity/v3/role_assignments?user.id=cf126c15be35403a9d3ba58ecc49d2b7&scope.project.id=5f087fd4b77a4ea4881ebed305b2300c&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:08.234181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.288561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:08.327796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 103/193] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:08 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:08.335839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.361097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f2a42-0656-4e95-a875-5426077edb17 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.416175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.417160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.417587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.418035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.496354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:08.506784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1998dd-83a1-4b65-98de-ae98a49bb651 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.514676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.516631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.556023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.556954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.557237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.557506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] PATH_INFO: `/v3/users/fead379928ec48bd8668a1285a3dd831` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.559472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=fead379928ec48bd8668a1285a3dd831)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.562412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.564666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 104/194] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:08 2022] GET /identity/v3/users/fead379928ec48bd8668a1285a3dd831 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:08.572988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.581929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:08.660483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 91/195] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:08.666614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.729314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565e5af-f797-4877-b99d-b5e8e6cfe0b1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.779296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.780380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.780671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.780950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.790592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ce217-23dd-4311-8b98-61d1090e7fc0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:08.822655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:08.834376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:08.835312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:08.835686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:08.836027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:08.837311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.838905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.841014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 92/196] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:08 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:08.846692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:08.865360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:08.896863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:08.898749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:08.964626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233a9e-04bb-4b08-bdc7-5c885a58f307 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:09.002894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:09.003706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:09.004133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:09.004410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:09.005247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=fead379928ec48bd8668a1285a3dd831) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:09.005557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:09.007041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:09.013601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 93/197] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:08 2022] GET /identity/v3/role_assignments?user.id=fead379928ec48bd8668a1285a3dd831&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:09.058748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 105/198] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:11:09.067698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:09.172103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:09.199553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe56ff-3cf7-4fb0-8c09-62dd87fb9579 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:09.236700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45bfec-cdbb-43d0-a38a-6dcc6fa18556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:09.238522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45bfec-cdbb-43d0-a38a-6dcc6fa18556 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:09.243084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45bfec-cdbb-43d0-a38a-6dcc6fa18556 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:09.243640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45bfec-cdbb-43d0-a38a-6dcc6fa18556 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:09.245203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45bfec-cdbb-43d0-a38a-6dcc6fa18556 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:09.246914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45bfec-cdbb-43d0-a38a-6dcc6fa18556 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:09.248999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 94/199] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:09 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:09.256108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:09.338427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:09.379020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298e34-db6e-4e54-b2f7-5ed975e06944 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:09.404523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f29b3-d713-423e-9730-5abe3d0cb07c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:09.405133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f29b3-d713-423e-9730-5abe3d0cb07c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:09.405639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f29b3-d713-423e-9730-5abe3d0cb07c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:09.407410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 95/200] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:09.412971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa200f-92db-49e5-b58d-4c54c8800a00 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:09.413664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa200f-92db-49e5-b58d-4c54c8800a00 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:09.414265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa200f-92db-49e5-b58d-4c54c8800a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:09.414788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:09.415453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:09.415736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:09.416013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:09.416854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] RBAC: Adding query filter params (role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=fead379928ec48bd8668a1285a3dd831) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:09.417164 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:09.419215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:09.424783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 106/201] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:09 2022] GET /identity/v3/role_assignments?user.id=fead379928ec48bd8668a1285a3dd831&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=1a4d2011cce6457b9a1d4462800949db => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:09.435903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fbfa200f-92db-49e5-b58d-4c54c8800a00 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:09.437453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fbfa200f-92db-49e5-b58d-4c54c8800a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:09.513864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 96/202] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:09.537661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:09.657544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b759f8-e9f6-4a00-9ed9-b4ecadf0b501 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:09.686421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:09.697639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:09.708720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:09.708720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:09.708720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:09.712448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:09.720282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:09.721151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:09.722129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 107/203] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:09.728347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa200f-92db-49e5-b58d-4c54c8800a00 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:09.818259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:09.849014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa200f-92db-49e5-b58d-4c54c8800a00 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:09.904879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:09.905554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:09.905836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:09.906115 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:09.906894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:09.907204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:09.908585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:09.922158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 97/204] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:09.928520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:10.081136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5962f4-74f8-42b2-bcd5-ce77c1527919 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:10.129812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:10.130719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:10.131005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:10.131281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] PATH_INFO: `/v3/users/7c4c0640cb5a4b6295f94b2125629c1a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:10.132516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] RBAC: Authorizing `identity:get_user(user_id=7c4c0640cb5a4b6295f94b2125629c1a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:10.133974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:10.136181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 108/205] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:09 2022] GET /identity/v3/users/7c4c0640cb5a4b6295f94b2125629c1a => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:10.141317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:10.266948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1bb4-5973-4729-92e0-2730f44b7dad None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:10.306000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:10.306667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:10.306963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:10.307243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:10.316732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:10.382374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:10.383807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:10.489526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 98/206] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:10.494876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:10.598680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:10.659153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a0c37-efa7-4c1d-ab89-f8cd2ecb7543 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:10.709508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60901b-23c7-4245-9fe1-1fa00d8c8287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:10.710378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60901b-23c7-4245-9fe1-1fa00d8c8287 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:10.710671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60901b-23c7-4245-9fe1-1fa00d8c8287 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:10.710957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60901b-23c7-4245-9fe1-1fa00d8c8287 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:10.712155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60901b-23c7-4245-9fe1-1fa00d8c8287 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:10.713620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60901b-23c7-4245-9fe1-1fa00d8c8287 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:10.715645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 109/207] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:10 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:10.721500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:10.793516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:10.879067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f55fb-e0cb-4495-a097-6c8678169d3d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:10.927872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b65675-2d29-43d1-bade-f76bdeb3d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:10.928441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b65675-2d29-43d1-bade-f76bdeb3d0ee None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:10.928724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b65675-2d29-43d1-bade-f76bdeb3d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:10.928992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b65675-2d29-43d1-bade-f76bdeb3d0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:10.929820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b65675-2d29-43d1-bade-f76bdeb3d0ee None admin] RBAC: Adding query filter params (role.id=07579953b0b047439d17ec419622f802, scope.project.id=c887c09296934553842076fabeae9c40, user.id=7c4c0640cb5a4b6295f94b2125629c1a) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:10.930129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b65675-2d29-43d1-bade-f76bdeb3d0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:10.931590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b65675-2d29-43d1-bade-f76bdeb3d0ee None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:10.943772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 99/208] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:10 2022] GET /identity/v3/role_assignments?user.id=7c4c0640cb5a4b6295f94b2125629c1a&scope.project.id=c887c09296934553842076fabeae9c40&role.id=07579953b0b047439d17ec419622f802 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:11.224645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6f45-387b-4d58-b714-67b8a64e513f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.224989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6f45-387b-4d58-b714-67b8a64e513f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.225178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6f45-387b-4d58-b714-67b8a64e513f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.226630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 110/209] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:11:11.231987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57e137-1554-413c-a62d-b7d8f6320cb7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.232279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57e137-1554-413c-a62d-b7d8f6320cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.232557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57e137-1554-413c-a62d-b7d8f6320cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.252467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fe57e137-1554-413c-a62d-b7d8f6320cb7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:11.254634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fe57e137-1554-413c-a62d-b7d8f6320cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:11.304392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431da5-cdb9-4317-ae00-ead3aaec6120 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.304891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431da5-cdb9-4317-ae00-ead3aaec6120 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.305177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431da5-cdb9-4317-ae00-ead3aaec6120 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.306878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 111/210] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:11.312800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a4f6-9373-41d4-bc1a-4643b2855459 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.313093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a4f6-9373-41d4-bc1a-4643b2855459 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.313375 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0a4f6-9373-41d4-bc1a-4643b2855459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.335187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 100/211] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:11.339690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dcc0a4f6-9373-41d4-bc1a-4643b2855459 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:11.340885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dcc0a4f6-9373-41d4-bc1a-4643b2855459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:11.365424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57e137-1554-413c-a62d-b7d8f6320cb7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:11.404173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:11.443269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 112/212] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:11.467619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0a4f6-9373-41d4-bc1a-4643b2855459 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:11.485669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57e137-1554-413c-a62d-b7d8f6320cb7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:11.531208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:11.532090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:11.534434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.534920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.535613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.537643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:11.539775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:11.542305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 101/213] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:11.547384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:11.591804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0a4f6-9373-41d4-bc1a-4643b2855459 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:11.638789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:11.640104 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.640538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.641430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.656217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:11.661188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:11.664462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:11.665357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:11.666581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 113/214] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:11.667884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186332-dcc4-4734-84f2-2f62fa3b6d1d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:11.671510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:11.711986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d2255-9d45-4fd4-92ec-05a5186fc6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:11.712667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d2255-9d45-4fd4-92ec-05a5186fc6ea None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.712953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d2255-9d45-4fd4-92ec-05a5186fc6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.713228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d2255-9d45-4fd4-92ec-05a5186fc6ea None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.713945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d2255-9d45-4fd4-92ec-05a5186fc6ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:11.715427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d2255-9d45-4fd4-92ec-05a5186fc6ea None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:11.780182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47974128-981f-4baf-8956-c40ebd8299aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:11.792964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:11.813982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:11.814682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.815000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.815288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.816871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:11.817186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:11.818865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:11.823282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 102/215] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:11 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:11:11.824611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f92cb-29c9-49b5-bee5-6c18301e7288 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.825110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f92cb-29c9-49b5-bee5-6c18301e7288 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.825232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f92cb-29c9-49b5-bee5-6c18301e7288 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.826720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 103/216] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:11.833445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118de6-d6e7-4601-8b67-a86761635193 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:11.834187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118de6-d6e7-4601-8b67-a86761635193 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:11.835057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59118de6-d6e7-4601-8b67-a86761635193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:11.837408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 114/217] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:11.843449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:11.860541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-59118de6-d6e7-4601-8b67-a86761635193 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:11.863579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-59118de6-d6e7-4601-8b67-a86761635193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:11.964310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 104/218] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:11.977770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08891b2b-063d-4f3a-9b14-d21f48cf148b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:11.988447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59118de6-d6e7-4601-8b67-a86761635193 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.025550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.028048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.028048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.028048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] PATH_INFO: `/v3/users/1b27c6f8df6040cca881c0a4d5b1cf5c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.049140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] RBAC: Authorizing `identity:get_user(user_id=1b27c6f8df6040cca881c0a4d5b1cf5c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.051331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.053263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 115/219] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:11 2022] GET /identity/v3/users/1b27c6f8df6040cca881c0a4d5b1cf5c => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:12.058689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.094759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.094968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.111118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59118de6-d6e7-4601-8b67-a86761635193 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.158799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4df0-8ae6-4dc8-8c89-ce55b89470a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.160320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4df0-8ae6-4dc8-8c89-ce55b89470a2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.160603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4df0-8ae6-4dc8-8c89-ce55b89470a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.161090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4df0-8ae6-4dc8-8c89-ce55b89470a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.173938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af4df0-8ae6-4dc8-8c89-ce55b89470a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-23af4df0-8ae6-4dc8-8c89-ce55b89470a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:12.183422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:12.184528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:12.185480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 105/220] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:12.186335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebd51-a7b4-427e-904e-575cb7b0ceda None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.186610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebd51-a7b4-427e-904e-575cb7b0ceda None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.186832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3687bb-084e-4a7e-8c59-46f6a11aff5d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.186912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebd51-a7b4-427e-904e-575cb7b0ceda None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.188328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 106/221] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:12.190406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ebd51-a7b4-427e-904e-575cb7b0ceda None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.231844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.232507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.232843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.233127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.320881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ebd51-a7b4-427e-904e-575cb7b0ceda None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.323676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.325260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.360008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.370712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3a8b-799e-4b15-b720-c1b4ca7f8f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.374703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3a8b-799e-4b15-b720-c1b4ca7f8f7b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.374703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3a8b-799e-4b15-b720-c1b4ca7f8f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.374703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3a8b-799e-4b15-b720-c1b4ca7f8f7b None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.374703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3a8b-799e-4b15-b720-c1b4ca7f8f7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:12.374703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3a8b-799e-4b15-b720-c1b4ca7f8f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.376053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3a8b-799e-4b15-b720-c1b4ca7f8f7b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.388682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 107/222] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:12.389967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2985f-fac5-4920-9e3c-a92c46e2dd67 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.390254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2985f-fac5-4920-9e3c-a92c46e2dd67 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.390528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2985f-fac5-4920-9e3c-a92c46e2dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.415364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-67d2985f-fac5-4920-9e3c-a92c46e2dd67 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:12.416565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-67d2985f-fac5-4920-9e3c-a92c46e2dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:12.419163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.446093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 116/223] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:11:12.446948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.508302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 108/224] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:12.511802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2985f-fac5-4920-9e3c-a92c46e2dd67 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.591447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147ba9d-7958-4310-b1ab-fe59c9934685 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.623491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.630293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.631402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.633010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.633010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] PATH_INFO: `/v3/users/fead379928ec48bd8668a1285a3dd831` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.633872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] RBAC: Authorizing `identity:get_user(user_id=fead379928ec48bd8668a1285a3dd831)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.635600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2985f-fac5-4920-9e3c-a92c46e2dd67 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.635995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.638391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 117/225] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/users/fead379928ec48bd8668a1285a3dd831 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:12.639400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.678954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.679594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.679875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.680152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.681403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.682888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.684894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 109/226] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:12.685723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.695998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.751976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36492-913f-44f7-bd00-53282c913d41 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.789656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.790751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.791207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.791663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.793035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb105236-c1e1-4a3a-bc7e-2aca477f522f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.804172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:12.813630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:12.814563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:12.815405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:12.823931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 118/227] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:12.825227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.829662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.830684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.830829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.832538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.833558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.835105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.837058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 110/228] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:12.837727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:12.893774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.922868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:12.940807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827917-a059-4c74-8e70-af7da47be1f6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.948794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62605fec-d84d-43a2-aa52-a89cb417c590 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:12.979678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.980759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.981271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.981784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.982909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=1b27c6f8df6040cca881c0a4d5b1cf5c) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:12.983424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.984771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:12.985436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:12.985719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:12.985991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:12.986311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.986752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:12.987061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:12.989167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:12.993258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 119/229] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/role_assignments?user.id=1b27c6f8df6040cca881c0a4d5b1cf5c&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:12.994398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:13.002202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 111/230] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:13.007800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:13.179122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7041c2a-a990-43bd-a3eb-5cbfce690f05 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:13.224400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a14e7-9b73-41e9-8f87-2813ac42f86e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:13.228550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:13.250223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:13.251204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:13.251576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:13.251861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d/users/fead379928ec48bd8668a1285a3dd831/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:13.256015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] RBAC: Authorizing `identity:create_grant(project_id=849a77e1da2d492b8607d4299a26579d, user_id=fead379928ec48bd8668a1285a3dd831, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:13.257510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:13.280779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:13.281767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:13.282048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:13.282377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] PATH_INFO: `/v3/users/fead379928ec48bd8668a1285a3dd831` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:13.283620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=fead379928ec48bd8668a1285a3dd831)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:13.285347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:13.287423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 112/231] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:13 2022] GET /identity/v3/users/fead379928ec48bd8668a1285a3dd831 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:13.293192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:13.299003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:13.324689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 120/232] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:12 2022] PUT /identity/v3/projects/849a77e1da2d492b8607d4299a26579d/users/fead379928ec48bd8668a1285a3dd831/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:13.436157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc109207-3938-4d40-87ea-6c5383c87dd3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:13.489394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db96ef-a50e-4a9d-98f1-e44329f214e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:13.493055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db96ef-a50e-4a9d-98f1-e44329f214e4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:13.493055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db96ef-a50e-4a9d-98f1-e44329f214e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:13.493055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db96ef-a50e-4a9d-98f1-e44329f214e4 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:13.495955 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db96ef-a50e-4a9d-98f1-e44329f214e4 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:13.497436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db96ef-a50e-4a9d-98f1-e44329f214e4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:13.499451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 113/233] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:13 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:13.506009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:13.648623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097ee4-f13c-4af9-99d2-360346880e4f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:13.697745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74bef6-b962-4ed5-a125-de9f22fa2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:13.698572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74bef6-b962-4ed5-a125-de9f22fa2795 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:13.698879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74bef6-b962-4ed5-a125-de9f22fa2795 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:13.699162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74bef6-b962-4ed5-a125-de9f22fa2795 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d/users/fead379928ec48bd8668a1285a3dd831/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:13.704442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74bef6-b962-4ed5-a125-de9f22fa2795 None admin] RBAC: Authorizing `identity:create_grant(project_id=849a77e1da2d492b8607d4299a26579d, user_id=fead379928ec48bd8668a1285a3dd831, role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:13.705914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74bef6-b962-4ed5-a125-de9f22fa2795 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:13.828437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 121/234] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:13 2022] PUT /identity/v3/projects/849a77e1da2d492b8607d4299a26579d/users/fead379928ec48bd8668a1285a3dd831/roles/1a4d2011cce6457b9a1d4462800949db => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:14.235534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1f8f-6d97-4399-b0d3-2702ad123b08 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:14.236041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1f8f-6d97-4399-b0d3-2702ad123b08 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:14.236147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1f8f-6d97-4399-b0d3-2702ad123b08 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:14.238090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 114/235] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:14.243616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e641-ccac-4041-8b76-1b719b5dfafb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:14.243906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e641-ccac-4041-8b76-1b719b5dfafb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:14.244185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e641-ccac-4041-8b76-1b719b5dfafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:14.267693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e3e1e641-ccac-4041-8b76-1b719b5dfafb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:14.270201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e3e1e641-ccac-4041-8b76-1b719b5dfafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:14.321031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:14.355479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 122/236] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:14.376391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd76ba-4517-4ecd-88df-35774677f90c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:14.378711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd76ba-4517-4ecd-88df-35774677f90c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:14.378711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd76ba-4517-4ecd-88df-35774677f90c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:14.379511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 115/237] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:14.396627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca085-45d1-4ee3-935c-0dd92428adf6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:14.396887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca085-45d1-4ee3-935c-0dd92428adf6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:14.397170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca085-45d1-4ee3-935c-0dd92428adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:14.404967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd76ba-4517-4ecd-88df-35774677f90c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:14.430433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7d4ca085-45d1-4ee3-935c-0dd92428adf6 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:14.431659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7d4ca085-45d1-4ee3-935c-0dd92428adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:14.539384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:14.549579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 123/238] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:14.574783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ca085-45d1-4ee3-935c-0dd92428adf6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:14.596406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd76ba-4517-4ecd-88df-35774677f90c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:14.672231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:14.673340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:14.673839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:14.674293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:14.676407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:14.678061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:14.679930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 116/239] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:14.687623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:14.701219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ca085-45d1-4ee3-935c-0dd92428adf6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:14.735076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:14.743260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:14.744204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:14.750466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:14.750466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:14.758194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:14.767957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:14.769509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:14.770661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:14.771293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 124/240] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:14.777720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:14.932142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285534f-2b42-49e5-a3ee-f3f6ddfb5422 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:14.958555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197473-ac3c-49b6-b7b3-784e8f6f1de2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:14.996566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:14.997251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:14.997539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:14.997817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:14.998569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:14.999711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:15.005771 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:15.017856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:15.018655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.019089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.019396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.020120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:15.021593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:15.025825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 125/241] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:15.031426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:15.047323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:15.072747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:15.139466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad1737-a944-460e-9ba4-66c7ca3a3f67 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:15.162887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 117/242] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:14 2022] POST /identity/v3/users => generated 293 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:15.180115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e126e44-ce93-4641-a6ed-c53d885b018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:15.181017 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126e44-ce93-4641-a6ed-c53d885b018c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.181300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126e44-ce93-4641-a6ed-c53d885b018c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.181578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126e44-ce93-4641-a6ed-c53d885b018c None admin] PATH_INFO: `/v3/users/0b9212c71b04412099025338ef0121a8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.197516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126e44-ce93-4641-a6ed-c53d885b018c None admin] RBAC: Authorizing `identity:get_user(user_id=0b9212c71b04412099025338ef0121a8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:15.199131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126e44-ce93-4641-a6ed-c53d885b018c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:15.201354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 126/243] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:15 2022] GET /identity/v3/users/0b9212c71b04412099025338ef0121a8 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:15.208420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:15.380199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333fd49-ed4b-409d-8368-cd7cb72cdc92 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:15.423614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:15.424517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.425547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.425999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.499016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:15.501694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:15.503797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:15.578218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b9e8b-0e28-42bb-9846-be77989fc794 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.580553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b9e8b-0e28-42bb-9846-be77989fc794 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.580553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b9e8b-0e28-42bb-9846-be77989fc794 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.580553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 127/244] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:15.589730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add074d0-60f9-46dc-ad6b-3ec652c09bc3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.590015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add074d0-60f9-46dc-ad6b-3ec652c09bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.590456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add074d0-60f9-46dc-ad6b-3ec652c09bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.612235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-add074d0-60f9-46dc-ad6b-3ec652c09bc3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:15.615494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-add074d0-60f9-46dc-ad6b-3ec652c09bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:15.625022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 118/245] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:15.632394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:15.708699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 128/246] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:15.744592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add074d0-60f9-46dc-ad6b-3ec652c09bc3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:15.757324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:15.764417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:15.765358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97002e6-20f8-4c84-8ea2-d73d996efd9d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:15.809823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:15.811105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.811616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.812104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.813552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:15.815297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:15.818107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 119/247] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:15 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:15.824151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:15.881600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add074d0-60f9-46dc-ad6b-3ec652c09bc3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:15.924234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92493-e071-44f6-a290-b31e03add7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:15.925732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92493-e071-44f6-a290-b31e03add7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.926100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92493-e071-44f6-a290-b31e03add7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.926476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92493-e071-44f6-a290-b31e03add7c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.938265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92493-e071-44f6-a290-b31e03add7c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-00e92493-e071-44f6-a290-b31e03add7c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:15.948685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:15.949778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:15.950769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:15.953307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 129/248] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:15.954567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedc93-7005-478f-a027-b20067048332 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:15.955050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedc93-7005-478f-a027-b20067048332 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:15.955607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acedc93-7005-478f-a027-b20067048332 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:15.961505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 130/249] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:15.962515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acedc93-7005-478f-a027-b20067048332 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:15.963220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7453ae4-a4b3-4f37-a0b4-40b02b73692b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:16.012796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f525ff5-7e04-4a86-bca3-8e49abbc2e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:16.013766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525ff5-7e04-4a86-bca3-8e49abbc2e88 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.014229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525ff5-7e04-4a86-bca3-8e49abbc2e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.014712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f525ff5-7e04-4a86-bca3-8e49abbc2e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.016323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f525ff5-7e04-4a86-bca3-8e49abbc2e88 None admin] RBAC: Adding query filter params (role.id=07579953b0b047439d17ec419622f802, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=0b9212c71b04412099025338ef0121a8) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:16.016821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f525ff5-7e04-4a86-bca3-8e49abbc2e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:16.019095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f525ff5-7e04-4a86-bca3-8e49abbc2e88 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:16.027390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 120/250] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:15 2022] GET /identity/v3/role_assignments?user.id=0b9212c71b04412099025338ef0121a8&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=07579953b0b047439d17ec419622f802 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:16.029186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c9253-2a98-4128-8f95-12ae9c50e04a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.029672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c9253-2a98-4128-8f95-12ae9c50e04a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.030115 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c9253-2a98-4128-8f95-12ae9c50e04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.051066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-542c9253-2a98-4128-8f95-12ae9c50e04a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:16.053344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-542c9253-2a98-4128-8f95-12ae9c50e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:16.078875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:16.084740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:16.149232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acedc93-7005-478f-a027-b20067048332 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:16.151643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 121/251] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:16.209039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:16.209802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.210109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.210376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.211171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:16.211484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:16.213102 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:16.229997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 131/252] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:16.235954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c9253-2a98-4128-8f95-12ae9c50e04a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:16.236497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:16.430180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ba12-1061-4445-ac5d-8292cb5eb24e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:16.430627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c9253-2a98-4128-8f95-12ae9c50e04a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:16.475357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:16.476086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.476373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.476649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.479444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:16.480997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c28e3-af10-4b6b-b340-941700f8f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:16.481979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c28e3-af10-4b6b-b340-941700f8f540 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.482264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c28e3-af10-4b6b-b340-941700f8f540 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.482544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c28e3-af10-4b6b-b340-941700f8f540 None admin] PATH_INFO: `/v3/users/1b27c6f8df6040cca881c0a4d5b1cf5c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.488098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c28e3-af10-4b6b-b340-941700f8f540 None admin] RBAC: Authorizing `identity:get_user(user_id=1b27c6f8df6040cca881c0a4d5b1cf5c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:16.489462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:16.509243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c28e3-af10-4b6b-b340-941700f8f540 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:16.509243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 122/253] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:16 2022] GET /identity/v3/users/1b27c6f8df6040cca881c0a4d5b1cf5c => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:16.509428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:16.510508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:16.511344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:16.511945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24a93-3466-4509-92d3-fa37243e33cb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.511945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24a93-3466-4509-92d3-fa37243e33cb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.511945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad24a93-3466-4509-92d3-fa37243e33cb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.512126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 132/254] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:16.512265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 123/255] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:16.512339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:16.512414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad24a93-3466-4509-92d3-fa37243e33cb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:16.559931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:16.689169 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8fde-3d15-4e72-b43f-a55b44545511 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:16.699973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad24a93-3466-4509-92d3-fa37243e33cb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:16.749056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbdc34-dfc2-4081-b449-49bf260e3c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:16.750982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbdc34-dfc2-4081-b449-49bf260e3c9c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.751420 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbdc34-dfc2-4081-b449-49bf260e3c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.751844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbdc34-dfc2-4081-b449-49bf260e3c9c None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.753777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbdc34-dfc2-4081-b449-49bf260e3c9c None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:16.755590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbdc34-dfc2-4081-b449-49bf260e3c9c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:16.757481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 133/256] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:16 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:16.758801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7cca9-429f-428d-9e67-62f7b747f550 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.759229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7cca9-429f-428d-9e67-62f7b747f550 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.759740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7cca9-429f-428d-9e67-62f7b747f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.762723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:16.763673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:16.764157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:16.764643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:16.765703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:16.766211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:16.767860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:16.783451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 124/257] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:16.785330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:16.801766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7dc7cca9-429f-428d-9e67-62f7b747f550 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:16.803301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7dc7cca9-429f-428d-9e67-62f7b747f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:16.901681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:16.916948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 134/258] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:16.917795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7cca9-429f-428d-9e67-62f7b747f550 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:16.992711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:17.011409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c120-6fa8-4f9e-8501-acadb64485e1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:17.052850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:17.054144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:17.054843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:17.056129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d/users/1b27c6f8df6040cca881c0a4d5b1cf5c/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:17.062562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] RBAC: Authorizing `identity:create_grant(project_id=849a77e1da2d492b8607d4299a26579d, user_id=1b27c6f8df6040cca881c0a4d5b1cf5c, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:17.064285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:17.095348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7cca9-429f-428d-9e67-62f7b747f550 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:17.136648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 125/259] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:16 2022] PUT /identity/v3/projects/849a77e1da2d492b8607d4299a26579d/users/1b27c6f8df6040cca881c0a4d5b1cf5c/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:17.143967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:17.157737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:17.163434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:17.164134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:17.164866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] PATH_INFO: `/v3/users/fead379928ec48bd8668a1285a3dd831` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:17.168934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] RBAC: Authorizing `identity:get_user(user_id=fead379928ec48bd8668a1285a3dd831)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:17.174672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:17.183034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 135/260] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:16 2022] GET /identity/v3/users/fead379928ec48bd8668a1285a3dd831 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:17.184505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:17.315792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:17.360753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0296f76-0f3d-4a1c-aea6-244ee9b3ce35 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:17.388957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be232135-77a5-4337-819e-92ffecfee1d3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:17.431918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:17.433550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:17.434044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:17.434519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:17.452613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:17.455763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:17.456824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:17.457556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:17.458275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:17.469973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:17.471012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:17.471860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:17.480606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 126/261] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:17.486359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:17.507103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:17.600061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:17.602597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:17.670185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fce32d-2a23-4402-9c9c-74aa0746c4ab None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:17.706673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:17.749389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 136/262] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:17.756142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:17.783402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:17.784151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:17.784991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:17.785273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:17.786145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:17.786356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:17.787795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:17.809183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 127/263] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:17.814446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:17.951930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f26e-3b4c-4378-881e-cc6c32db1c4f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:17.987544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:18.032330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:18.033576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.034087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.035113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.036923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:18.038717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:18.045501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 137/264] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:17 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:18.046706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:18.070944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e64c6-d3b9-426f-b438-fd0c336bb18a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:18.099077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:18.180226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bf722-c02e-49ff-9438-b93a39729fc3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:18.213587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:18.214416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.214728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.215009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] PATH_INFO: `/v3/users/fead379928ec48bd8668a1285a3dd831` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.218524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78bb6-414e-4672-9371-26d197a2d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:18.219377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] RBAC: Authorizing `identity:get_user(user_id=fead379928ec48bd8668a1285a3dd831)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:18.219684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78bb6-414e-4672-9371-26d197a2d520 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.220212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78bb6-414e-4672-9371-26d197a2d520 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.220723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78bb6-414e-4672-9371-26d197a2d520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.220845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:18.222469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78bb6-414e-4672-9371-26d197a2d520 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=fead379928ec48bd8668a1285a3dd831) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:18.223155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78bb6-414e-4672-9371-26d197a2d520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:18.223539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 128/265] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:17 2022] GET /identity/v3/users/fead379928ec48bd8668a1285a3dd831 => generated 283 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:18.225170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78bb6-414e-4672-9371-26d197a2d520 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:18.229045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:18.232690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 138/266] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:18 2022] GET /identity/v3/role_assignments?user.id=fead379928ec48bd8668a1285a3dd831&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:18.349819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675809be-bd40-4113-a75c-121c02ba311c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:18.389371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:18.390418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.390976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.391461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.407110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:18.438803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313caa-a0b4-4b41-991e-95bbacb52b8e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.439649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313caa-a0b4-4b41-991e-95bbacb52b8e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.440052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313caa-a0b4-4b41-991e-95bbacb52b8e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.442471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 139/267] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:18.451779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940f6d-ddc2-4224-b1fb-ca588925258a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.452216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940f6d-ddc2-4224-b1fb-ca588925258a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.452635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67940f6d-ddc2-4224-b1fb-ca588925258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.493348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-67940f6d-ddc2-4224-b1fb-ca588925258a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:18.494494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-67940f6d-ddc2-4224-b1fb-ca588925258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:18.507547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:18.509070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:18.622095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 140/268] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:18.624397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67ebe-3665-4cc9-be33-c569d8f33be3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.624693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67ebe-3665-4cc9-be33-c569d8f33be3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.625260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67ebe-3665-4cc9-be33-c569d8f33be3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.629026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 141/269] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:18.640102 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2d38-5669-4d9e-978b-6b4405b7d525 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.640391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2d38-5669-4d9e-978b-6b4405b7d525 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.640670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2d38-5669-4d9e-978b-6b4405b7d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.668647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d6bd2d38-5669-4d9e-978b-6b4405b7d525 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:18.669968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d6bd2d38-5669-4d9e-978b-6b4405b7d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:18.691546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:18.693909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 129/270] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:18.695316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:18.756437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:18.774110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 142/271] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:18.775037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2d38-5669-4d9e-978b-6b4405b7d525 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:18.842736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9260c-fe88-412d-8cff-2130371de1b6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:18.893363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:18.894222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.894509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.894819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.909639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:18.909957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2d38-5669-4d9e-978b-6b4405b7d525 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:18.919345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:18.920239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:18.921066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:18.921681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 130/272] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:18.926664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:18.957331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:18.958474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:18.958793 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:18.959334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:18.961257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:18.963305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:18.965510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 143/273] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:18 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:18.966404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:18.997943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:19.041066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:19.046949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8004f-2425-40d7-8ad3-bb7cd9db3623 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.091578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.092391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.092678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.092961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.093819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb7079-3a83-4fd2-af41-bceb8072f8d5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.094195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:19.096002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:19.099488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 131/274] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:19.100380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:19.137503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.138470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.138795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.139082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.139851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:19.140166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:19.142270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:19.158785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 144/275] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:19.160423 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:19.223955 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc88c7-742e-480e-846b-f9832e4135c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.256930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:19.262625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.263319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.263703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.264006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.264798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] RBAC: Adding query filter params (role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=fead379928ec48bd8668a1285a3dd831) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:19.265120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:19.266578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:19.273199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933920d3-ea8e-412c-b94a-fe8ec8f4a19b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.278981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 132/276] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:19 2022] GET /identity/v3/role_assignments?user.id=fead379928ec48bd8668a1285a3dd831&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=1a4d2011cce6457b9a1d4462800949db => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:19.279819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:19.314381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835538b-7ff7-48bb-8005-292893222677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.315100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835538b-7ff7-48bb-8005-292893222677 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.315977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835538b-7ff7-48bb-8005-292893222677 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.316258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835538b-7ff7-48bb-8005-292893222677 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.317110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835538b-7ff7-48bb-8005-292893222677 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:19.318602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835538b-7ff7-48bb-8005-292893222677 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:19.319926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:19.405580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99161-24f8-4a58-bcf6-d766c4e6e00f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.448202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.448970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 145/277] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:19 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:19.449420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.449713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.450039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] PATH_INFO: `/v3/users/66d04453e38745138bcf4ee1a8c38ccd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.451365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05420826-bf7a-4bdc-bcef-c977f8cb5da9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.452410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05420826-bf7a-4bdc-bcef-c977f8cb5da9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.452707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05420826-bf7a-4bdc-bcef-c977f8cb5da9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.454407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 146/278] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:19.464616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188e78-1fda-491b-b05d-3618fc9c778b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.465253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188e78-1fda-491b-b05d-3618fc9c778b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.465763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188e78-1fda-491b-b05d-3618fc9c778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.480453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] RBAC: Authorizing `identity:get_user(user_id=66d04453e38745138bcf4ee1a8c38ccd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:19.482065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:19.483988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 133/279] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:19 2022] GET /identity/v3/users/66d04453e38745138bcf4ee1a8c38ccd => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:19.492040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:19.496480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-52188e78-1fda-491b-b05d-3618fc9c778b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:19.499011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-52188e78-1fda-491b-b05d-3618fc9c778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:19.580202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 147/280] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:19.603664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188e78-1fda-491b-b05d-3618fc9c778b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:19.608462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:19.623949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48392072-547f-40f2-82be-2f4ce4417173 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.672663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.673418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.673768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.674071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.675768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, user.id=66d04453e38745138bcf4ee1a8c38ccd, scope.system=all) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:19.676157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:19.677795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:19.684320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:19.685267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 134/281] 10.222.0.87 () {56 vars in 1308 bytes} [Wed Jul 20 15:11:19 2022] GET /identity/v3/role_assignments?user.id=66d04453e38745138bcf4ee1a8c38ccd&scope.system=all&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:19.721628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188e78-1fda-491b-b05d-3618fc9c778b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.764359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.765263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.765551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.765828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.779190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:19.788428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:19.789365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:19.790171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 148/282] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:19.796068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:19.911074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f342fe-7604-42ee-8218-d9a0c0e1b628 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:19.955746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e480f2b-0ecc-4edf-9fce-e3a08e7c46b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:19.956527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e480f2b-0ecc-4edf-9fce-e3a08e7c46b7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:19.956812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e480f2b-0ecc-4edf-9fce-e3a08e7c46b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:19.957095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e480f2b-0ecc-4edf-9fce-e3a08e7c46b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:19.957859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e480f2b-0ecc-4edf-9fce-e3a08e7c46b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:19.958172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e480f2b-0ecc-4edf-9fce-e3a08e7c46b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:19.959597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e480f2b-0ecc-4edf-9fce-e3a08e7c46b7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:19.968819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 135/283] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:19.974881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:20.020501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241d89c-e981-43dc-b8b9-1705cae9860d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.020810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241d89c-e981-43dc-b8b9-1705cae9860d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.021065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241d89c-e981-43dc-b8b9-1705cae9860d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.022446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 136/284] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:20.027662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687dd8-9876-441e-8e2c-82e3d0fa3518 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.027950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687dd8-9876-441e-8e2c-82e3d0fa3518 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.028231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687dd8-9876-441e-8e2c-82e3d0fa3518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.052664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-33687dd8-9876-441e-8e2c-82e3d0fa3518 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:20.053889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-33687dd8-9876-441e-8e2c-82e3d0fa3518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:20.072212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:20.157988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c180b-adfb-4e77-85a3-0c755d644eda None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:20.181647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 137/285] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:20.198347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:20.204257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:20.206939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.207229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.210848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] PATH_INFO: `/v3/users/0b9212c71b04412099025338ef0121a8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.210848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=0b9212c71b04412099025338ef0121a8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:20.212991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:20.217539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 149/286] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:19 2022] GET /identity/v3/users/0b9212c71b04412099025338ef0121a8 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:20.223477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687dd8-9876-441e-8e2c-82e3d0fa3518 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:20.227527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:20.363659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48380f36-b510-4460-ba39-9419f736a8b5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:20.406961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:20.409631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687dd8-9876-441e-8e2c-82e3d0fa3518 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:20.410780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.411213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.411656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.414301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:20.415951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:20.424498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 150/287] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:20 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:20.430461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:20.474046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:20.475129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.475556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.475977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.504203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:20.520974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:20.522082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:20.523112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:20.533437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 138/288] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:20.539520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:20.545120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:20.596278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:20.673884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7c733-e9ed-4535-bf5e-5cd33a9e03a4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:20.689383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80d853-5de6-44de-ad1f-d4209eefb7c5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:20.720282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:20.721118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.721681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.721903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.722789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:20.723195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:20.724741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:20.742664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:20.743970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.744539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.744960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d/users/0b9212c71b04412099025338ef0121a8/roles/07579953b0b047439d17ec419622f802` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.746367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 139/289] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:20.747250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] RBAC: Authorizing `identity:create_grant(project_id=849a77e1da2d492b8607d4299a26579d, user_id=0b9212c71b04412099025338ef0121a8, role_id=07579953b0b047439d17ec419622f802)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:20.748817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:20.752049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:20.822542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 151/290] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:20 2022] PUT /identity/v3/projects/849a77e1da2d492b8607d4299a26579d/users/0b9212c71b04412099025338ef0121a8/roles/07579953b0b047439d17ec419622f802 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:11:20.832261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:20.874563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e27517-c60c-4a76-97dc-e79c6921decd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:20.915193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:20.916434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:20.916873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:20.917349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] PATH_INFO: `/v3/users/1b27c6f8df6040cca881c0a4d5b1cf5c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:20.918932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] RBAC: Authorizing `identity:get_user(user_id=1b27c6f8df6040cca881c0a4d5b1cf5c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:20.920586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:20.922809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 140/291] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:20 2022] GET /identity/v3/users/1b27c6f8df6040cca881c0a4d5b1cf5c => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:20.931895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:21.074567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f6e4-8ea4-4b76-9320-28c842f830be None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:21.104685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:21.114034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:21.114735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:21.115024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:21.115353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:21.199703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:21.201176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:21.311317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 152/292] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:21.317219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:21.422589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8f05-2e29-4989-99e5-16b871e5d210 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:21.457226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597fe1e-6e31-4d1d-bc20-46ff0cbd4415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:21.458086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597fe1e-6e31-4d1d-bc20-46ff0cbd4415 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:21.458371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597fe1e-6e31-4d1d-bc20-46ff0cbd4415 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:21.458670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597fe1e-6e31-4d1d-bc20-46ff0cbd4415 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:21.459863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597fe1e-6e31-4d1d-bc20-46ff0cbd4415 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:21.461305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597fe1e-6e31-4d1d-bc20-46ff0cbd4415 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:21.463344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 141/293] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:21 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:21.469181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:21.502416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:21.599288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df5f0-a1c6-46bf-9e73-a8f45e6a1d1e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:21.650142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9411f-1442-4ce5-8284-934c6d0aa221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:21.650844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9411f-1442-4ce5-8284-934c6d0aa221 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:21.651134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9411f-1442-4ce5-8284-934c6d0aa221 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:21.651415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9411f-1442-4ce5-8284-934c6d0aa221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:21.652268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9411f-1442-4ce5-8284-934c6d0aa221 None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=1b27c6f8df6040cca881c0a4d5b1cf5c) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:21.652586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9411f-1442-4ce5-8284-934c6d0aa221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:21.654035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9411f-1442-4ce5-8284-934c6d0aa221 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:21.661361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 153/294] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:21 2022] GET /identity/v3/role_assignments?user.id=1b27c6f8df6040cca881c0a4d5b1cf5c&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:22.079563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e2fe1-88df-4537-9d14-177ac58bad33 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.080285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e2fe1-88df-4537-9d14-177ac58bad33 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.080285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e2fe1-88df-4537-9d14-177ac58bad33 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.082362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 142/295] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:22.087490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc93ec3-b860-4430-b43d-505807336f47 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.087984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc93ec3-b860-4430-b43d-505807336f47 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.088152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc93ec3-b860-4430-b43d-505807336f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.108256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0dc93ec3-b860-4430-b43d-505807336f47 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:22.109437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0dc93ec3-b860-4430-b43d-505807336f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:22.180334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42bd6d-9bec-4ede-b0d4-420aea49eb65 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.180646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42bd6d-9bec-4ede-b0d4-420aea49eb65 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.180894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42bd6d-9bec-4ede-b0d4-420aea49eb65 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.183277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 143/296] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:22.183877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 154/297] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:22.210655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d300ec-71cf-4baf-ac84-6475074af628 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.210948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc93ec3-b860-4430-b43d-505807336f47 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.211125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d300ec-71cf-4baf-ac84-6475074af628 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.211294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d300ec-71cf-4baf-ac84-6475074af628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.217612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:22.238771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-93d300ec-71cf-4baf-ac84-6475074af628 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:22.240341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-93d300ec-71cf-4baf-ac84-6475074af628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:22.241394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:22.323795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc93ec3-b860-4430-b43d-505807336f47 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:22.325467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 144/298] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:22.349829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d300ec-71cf-4baf-ac84-6475074af628 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.364005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f6fac-081c-4069-b88f-0eba4070f49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:22.364820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6fac-081c-4069-b88f-0eba4070f49b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.365105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6fac-081c-4069-b88f-0eba4070f49b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.365384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6fac-081c-4069-b88f-0eba4070f49b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.376556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f6fac-081c-4069-b88f-0eba4070f49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5d2f6fac-081c-4069-b88f-0eba4070f49b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:22.385895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:22.388121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:22.390001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:22.394680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 155/299] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:22.394680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7f19-2f0e-42eb-b8d5-71901bd4db7a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.394680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7f19-2f0e-42eb-b8d5-71901bd4db7a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.395202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7f19-2f0e-42eb-b8d5-71901bd4db7a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.396892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 156/300] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:22.399594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b7f19-2f0e-42eb-b8d5-71901bd4db7a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.458883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d300ec-71cf-4baf-ac84-6475074af628 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:22.491716 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:22.496956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:22.501761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77558e-1270-4038-9189-1b6adf4076a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:22.502791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77558e-1270-4038-9189-1b6adf4076a4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.503132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77558e-1270-4038-9189-1b6adf4076a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.503414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77558e-1270-4038-9189-1b6adf4076a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77558e-1270-4038-9189-1b6adf4076a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:22.520205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b7f19-2f0e-42eb-b8d5-71901bd4db7a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cf77558e-1270-4038-9189-1b6adf4076a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:22.527658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:22.528585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:22.529382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 145/301] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:22.530340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d5f00-b084-483a-ad82-5d132dbbc4db None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.530427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d5f00-b084-483a-ad82-5d132dbbc4db None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.530738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d5f00-b084-483a-ad82-5d132dbbc4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.552996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-105d5f00-b084-483a-ad82-5d132dbbc4db None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:22.554184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-105d5f00-b084-483a-ad82-5d132dbbc4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:22.562101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:22.562788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.563077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.563345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.564085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:22.564389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:22.566464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:22.575590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 157/302] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:22.576200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.628060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 146/303] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:22.629186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d5f00-b084-483a-ad82-5d132dbbc4db None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.699305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e9597-7e4b-4302-baae-85e2c75c1b3f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:22.733459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d5f00-b084-483a-ad82-5d132dbbc4db None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:22.735619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:22.736546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.736546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.736827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.738248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:22.738558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:22.739965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:22.748438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 158/304] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:22.749656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.755414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:22.763265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:22.775832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:22.776712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.776986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.777260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] PATH_INFO: `/v3/users/66d04453e38745138bcf4ee1a8c38ccd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.778451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] RBAC: Authorizing `identity:get_user(user_id=66d04453e38745138bcf4ee1a8c38ccd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:22.779931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:22.781921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 147/305] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:22 2022] GET /identity/v3/users/66d04453e38745138bcf4ee1a8c38ccd => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:22.782699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.870886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924cbd3-45b0-44be-87b4-2481ec8f8db6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:22.889626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4cc206-42db-475d-8122-8fe7bcf3d538 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:22.907229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:22.908324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.908806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.909835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.911312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:22.912854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:22.914472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 159/306] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:22.915233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.929032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:22.929913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:22.930197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:22.930473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] PATH_INFO: `/v3/users/0450b2f70e844181b874330903e25ed4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:22.944272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0450b2f70e844181b874330903e25ed4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:22.945749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:22.947537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 148/307] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:22 2022] GET /identity/v3/users/0450b2f70e844181b874330903e25ed4 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:22.952910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:22.990997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:23.003645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:23.021671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca71fdc-0c3a-4751-83fe-a585ebc9e898 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:23.056429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:23.057029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976ab8-5f2a-4283-a7e0-07825cc9c6f8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:23.057302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:23.057588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:23.057865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] PATH_INFO: `/v3/system/users/66d04453e38745138bcf4ee1a8c38ccd/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:23.059379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66d04453e38745138bcf4ee1a8c38ccd, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:23.060798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:23.092259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f5cf-a8a7-45fe-82fa-f2bebc5010c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:23.092927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f5cf-a8a7-45fe-82fa-f2bebc5010c2 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:23.093210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f5cf-a8a7-45fe-82fa-f2bebc5010c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:23.093488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f5cf-a8a7-45fe-82fa-f2bebc5010c2 None admin] PATH_INFO: `/v3/groups` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:23.094207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1f5cf-a8a7-45fe-82fa-f2bebc5010c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:23.095682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1f5cf-a8a7-45fe-82fa-f2bebc5010c2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:23.160027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 160/308] 10.222.0.87 () {58 vars in 1334 bytes} [Wed Jul 20 15:11:22 2022] PUT /identity/v3/system/users/66d04453e38745138bcf4ee1a8c38ccd/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:23.160827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:23.207747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 149/309] 10.222.0.87 () {60 vars in 1134 bytes} [Wed Jul 20 15:11:22 2022] POST /identity/v3/groups => generated 229 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:23.292515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614b070-0cda-43d9-bc3b-572c3490bc23 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:23.337466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:23.338157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:23.338440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:23.338746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:23.339609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] RBAC: Adding query filter params (role.id=07579953b0b047439d17ec419622f802, user.id=0450b2f70e844181b874330903e25ed4, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:23.339941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:23.341432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:23.341943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c27d3-106a-4620-8799-5e82462fbd45 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:23.342200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c27d3-106a-4620-8799-5e82462fbd45 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:23.342478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c27d3-106a-4620-8799-5e82462fbd45 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:23.344263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 150/310] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:23.344583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:23.349818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 161/311] 10.222.0.87 () {56 vars in 1308 bytes} [Wed Jul 20 15:11:23 2022] GET /identity/v3/role_assignments?user.id=0450b2f70e844181b874330903e25ed4&scope.system=all&role.id=07579953b0b047439d17ec419622f802 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:23.350323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733d75-a33b-45b3-9cd7-33f6f2481b8f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:23.350622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733d75-a33b-45b3-9cd7-33f6f2481b8f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:23.350948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4733d75-a33b-45b3-9cd7-33f6f2481b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:23.373344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c4733d75-a33b-45b3-9cd7-33f6f2481b8f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:23.374673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c4733d75-a33b-45b3-9cd7-33f6f2481b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:23.456858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 151/312] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:23.480126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:23.604396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb9e0d-5868-4a9f-a192-252e501ad20e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:23.641466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:23.642270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:23.642556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:23.642867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:23.654102 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:23.662040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:23.662974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:23.663758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 162/313] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:23.669470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733d75-a33b-45b3-9cd7-33f6f2481b8f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:23.713514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:23.777059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4733d75-a33b-45b3-9cd7-33f6f2481b8f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:23.813207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:23.813883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:23.814169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:23.814450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:23.815804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:23.817405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:23.818823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:23.827842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 152/314] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:23.834731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:23.938080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:23.982862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f42156-311c-47de-a6a1-78357e947052 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:24.020780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:24.022047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:24.022540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:24.023071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] PATH_INFO: `/v3/users/0b9212c71b04412099025338ef0121a8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:24.024497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] RBAC: Authorizing `identity:get_user(user_id=0b9212c71b04412099025338ef0121a8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:24.026144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:24.028311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 163/315] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:23 2022] GET /identity/v3/users/0b9212c71b04412099025338ef0121a8 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:24.035054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:24.138865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:24.144351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ae75-3b80-4b2b-81e2-37793050822d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:24.179418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:24.180377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:24.180892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:24.181366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:24.249285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:24.251128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:24.350708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:24.355213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 153/316] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:24.360723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:24.468660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc961-96dc-4f42-9cca-f98d980f3e97 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:24.499058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:24.507824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b2b9c-c076-45e4-b810-87c43198d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:24.509172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2b9c-c076-45e4-b810-87c43198d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:24.509456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2b9c-c076-45e4-b810-87c43198d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:24.509734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b2b9c-c076-45e4-b810-87c43198d0d3 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:24.511482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b2b9c-c076-45e4-b810-87c43198d0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:24.512976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b2b9c-c076-45e4-b810-87c43198d0d3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:24.519105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 164/317] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:24 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:24.521790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:24.627637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f819548-e599-402c-98fb-3ee5a8977537 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:24.664358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f13ee-5a65-4374-a0af-af3087478335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:24.665009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f13ee-5a65-4374-a0af-af3087478335 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:24.665288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f13ee-5a65-4374-a0af-af3087478335 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:24.665560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f13ee-5a65-4374-a0af-af3087478335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:24.666386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f13ee-5a65-4374-a0af-af3087478335 None admin] RBAC: Adding query filter params (role.id=07579953b0b047439d17ec419622f802, scope.project.id=849a77e1da2d492b8607d4299a26579d, user.id=0b9212c71b04412099025338ef0121a8) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:24.666720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f13ee-5a65-4374-a0af-af3087478335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:24.668154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f13ee-5a65-4374-a0af-af3087478335 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:24.674073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 154/318] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:24 2022] GET /identity/v3/role_assignments?user.id=0b9212c71b04412099025338ef0121a8&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=07579953b0b047439d17ec419622f802 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:25.323930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6b3a-19d5-464f-af4e-603ad9cadd5b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.324285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6b3a-19d5-464f-af4e-603ad9cadd5b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.324499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c6b3a-19d5-464f-af4e-603ad9cadd5b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.326033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 165/319] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:25.331617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48ebdc-6b48-42ed-9a10-e4363ca28202 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.332055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48ebdc-6b48-42ed-9a10-e4363ca28202 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.332230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48ebdc-6b48-42ed-9a10-e4363ca28202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.349142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7c48ebdc-6b48-42ed-9a10-e4363ca28202 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:25.350353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7c48ebdc-6b48-42ed-9a10-e4363ca28202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:25.411731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:25.420392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 155/320] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:25.444191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6b3a-19d5-464f-af4e-603ad9cadd5b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:25.457025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ff9cf-64ae-4a4c-927e-c043a88236e8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.457315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ff9cf-64ae-4a4c-927e-c043a88236e8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.457596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ff9cf-64ae-4a4c-927e-c043a88236e8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.459053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 156/321] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:11:25.460115 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6639-b117-44dd-b3c1-b7a4c8fbd1e9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.460398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6639-b117-44dd-b3c1-b7a4c8fbd1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.460672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e6639-b117-44dd-b3c1-b7a4c8fbd1e9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.461882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 157/322] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:25.463823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d5f5-4a00-4f74-a975-d31b27aa3986 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.464443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d5f5-4a00-4f74-a975-d31b27aa3986 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.464725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d5f5-4a00-4f74-a975-d31b27aa3986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.481786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-afe0d5f5-4a00-4f74-a975-d31b27aa3986 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:25.483147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-afe0d5f5-4a00-4f74-a975-d31b27aa3986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:25.553262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c6b3a-19d5-464f-af4e-603ad9cadd5b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:25.553586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 158/323] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:25.558883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616f90-aabd-43dc-8cbd-eb18a5a0ed2a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.558883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616f90-aabd-43dc-8cbd-eb18a5a0ed2a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.558883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616f90-aabd-43dc-8cbd-eb18a5a0ed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.571804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-63616f90-aabd-43dc-8cbd-eb18a5a0ed2a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:25.573008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-63616f90-aabd-43dc-8cbd-eb18a5a0ed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:25.587344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:25.588146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.588429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.588702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.599500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:25.607156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:25.608228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:25.609041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 166/324] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:25.609716 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:25.642441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 159/325] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:25.649416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616f90-aabd-43dc-8cbd-eb18a5a0ed2a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:25.665701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:25.705301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:25.709727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860cf8b-1100-4416-ae7b-2032c873bda9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:25.743350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:25.744157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.744449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.744725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.751568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616f90-aabd-43dc-8cbd-eb18a5a0ed2a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:25.754720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:25.762674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:25.763582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:25.764386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 167/326] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:25.765057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:25.788855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:25.789531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.789816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.790945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.790945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:25.791239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:25.792632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:25.800703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 160/327] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:25.801478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:25.868516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ed8fd-b8c6-4820-8fec-773be7f61063 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:25.884192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:25.902042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:25.902320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05302b15-b2d4-41f9-af48-f30f2d6f5242 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:25.902861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.903149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.903429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.904600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:25.906059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:25.907711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 168/328] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:25.908473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:25.919675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:25.936925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:25.937590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:25.937874 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:25.938150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:25.938930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:25.939237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:25.940662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:25.950925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 161/329] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:25.951598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:26.009939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3e9a5-8c2c-475e-b604-a4e1a255cc6c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:26.045130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:26.046008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:26.046296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:26.046578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] PATH_INFO: `/v3/users/66d04453e38745138bcf4ee1a8c38ccd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:26.047808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] RBAC: Authorizing `identity:get_user(user_id=66d04453e38745138bcf4ee1a8c38ccd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:26.049261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:26.049373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0764c09-05eb-44fe-81c9-e2499cd1cf1d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:26.051123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 169/330] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:25 2022] GET /identity/v3/users/66d04453e38745138bcf4ee1a8c38ccd => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:26.051898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:26.086118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:26.086825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:26.087112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:26.087392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] PATH_INFO: `/v3/groups` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:26.088078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:26.089515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:26.104631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:26.150381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b5fa-2600-40e6-aab9-711edc446a6d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:26.182323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:26.183326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:26.183615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:26.183898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] PATH_INFO: `/v3/users/0450b2f70e844181b874330903e25ed4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:26.185136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] RBAC: Authorizing `identity:get_user(user_id=0450b2f70e844181b874330903e25ed4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:26.186574 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:26.187104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 162/331] 10.222.0.87 () {60 vars in 1134 bytes} [Wed Jul 20 15:11:25 2022] POST /identity/v3/groups => generated 226 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:26.195192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:26.195345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 170/332] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:26 2022] GET /identity/v3/users/0450b2f70e844181b874330903e25ed4 => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:26.196668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:26.249680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:26.313245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b38885-ad06-49ab-a24d-8e06648b516b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:26.317612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2023af5-9147-4da0-8cb7-8f823fce5ee9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:26.337599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:26.354876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f070437-92a1-4edc-bb09-c0299d027f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:26.355755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f070437-92a1-4edc-bb09-c0299d027f80 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:26.356037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f070437-92a1-4edc-bb09-c0299d027f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:26.356992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f070437-92a1-4edc-bb09-c0299d027f80 None admin] PATH_INFO: `/v3/system/users/0450b2f70e844181b874330903e25ed4/roles/07579953b0b047439d17ec419622f802` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:26.358377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f070437-92a1-4edc-bb09-c0299d027f80 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0450b2f70e844181b874330903e25ed4, role_id=07579953b0b047439d17ec419622f802)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:26.360239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7cb46-396e-4c42-9ef0-10c8e95dc793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:26.360690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f070437-92a1-4edc-bb09-c0299d027f80 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:26.360765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7cb46-396e-4c42-9ef0-10c8e95dc793 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:26.360765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7cb46-396e-4c42-9ef0-10c8e95dc793 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:26.360765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7cb46-396e-4c42-9ef0-10c8e95dc793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:26.361333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7cb46-396e-4c42-9ef0-10c8e95dc793 None admin] RBAC: Adding query filter params (role.id=6ad1c431efee442b8f305d707b3adc85, user.id=66d04453e38745138bcf4ee1a8c38ccd, scope.system=all) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:26.361638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7cb46-396e-4c42-9ef0-10c8e95dc793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:26.364663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7cb46-396e-4c42-9ef0-10c8e95dc793 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:26.378274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 163/333] 10.222.0.87 () {56 vars in 1308 bytes} [Wed Jul 20 15:11:26 2022] GET /identity/v3/role_assignments?user.id=66d04453e38745138bcf4ee1a8c38ccd&scope.system=all&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:26.422863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 171/334] 10.222.0.87 () {58 vars in 1334 bytes} [Wed Jul 20 15:11:26 2022] PUT /identity/v3/system/users/0450b2f70e844181b874330903e25ed4/roles/07579953b0b047439d17ec419622f802 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:28.979362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d48c-6d60-41e1-93c6-49b8727eb1fb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:28.979913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d48c-6d60-41e1-93c6-49b8727eb1fb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:28.979913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d48c-6d60-41e1-93c6-49b8727eb1fb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:28.981736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 164/335] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:28.992763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f46e-f33a-4e1a-a5ff-1976f3164f67 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:28.993682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f46e-f33a-4e1a-a5ff-1976f3164f67 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:28.994199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f46e-f33a-4e1a-a5ff-1976f3164f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.018577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a2e4f46e-f33a-4e1a-a5ff-1976f3164f67 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:29.020309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a2e4f46e-f33a-4e1a-a5ff-1976f3164f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:29.080469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e048f-70e9-416e-a4bd-19a7ccb69e63 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.080469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e048f-70e9-416e-a4bd-19a7ccb69e63 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.080469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e048f-70e9-416e-a4bd-19a7ccb69e63 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.080469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 165/336] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:29.099867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800147-8067-47ca-8633-ea826019e490 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.099867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800147-8067-47ca-8633-ea826019e490 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.099867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800147-8067-47ca-8633-ea826019e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.117004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 172/337] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:29.139709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dc800147-8067-47ca-8633-ea826019e490 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:29.140957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dc800147-8067-47ca-8633-ea826019e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:29.150350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f46e-f33a-4e1a-a5ff-1976f3164f67 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:29.281263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f46e-f33a-4e1a-a5ff-1976f3164f67 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:29.292614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 166/338] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:29.301207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:29.327956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc800147-8067-47ca-8633-ea826019e490 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:29.329512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:29.330719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.331495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.332001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.348478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:29.356931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:29.357855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 15:11:29.358675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:29.361612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 173/339] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:29.368480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:29.370388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:29.502154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc800147-8067-47ca-8633-ea826019e490 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:29.530913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ef17-7768-48d9-b803-cc02a03b5a0d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:29.592300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:29.593111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.593394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.593668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.618816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:29.626608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:29.627533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:29.629412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:29.630018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:29.630018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.630018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.630018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.630793 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:29.630963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:29.633655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:29.636074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 167/340] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:29.647803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:29.654812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 174/341] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:29.676768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:29.734264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:29.778717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:29.801117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71111073-6d58-4df5-ad49-9f2977dad236 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:29.828905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c779cc-e259-41af-9e19-f747341bc4fa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:29.855636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3eb44-7c03-45e4-88ab-45f29cedf4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:29.856878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3eb44-7c03-45e4-88ab-45f29cedf4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.857536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3eb44-7c03-45e4-88ab-45f29cedf4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.858015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3eb44-7c03-45e4-88ab-45f29cedf4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.859597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3eb44-7c03-45e4-88ab-45f29cedf4b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:29.860114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3eb44-7c03-45e4-88ab-45f29cedf4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:29.862515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3eb44-7c03-45e4-88ab-45f29cedf4b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:29.871044 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac7cbd-79e7-4d23-993e-365e9fc24e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:29.871941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac7cbd-79e7-4d23-993e-365e9fc24e8d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.872227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac7cbd-79e7-4d23-993e-365e9fc24e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.872504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac7cbd-79e7-4d23-993e-365e9fc24e8d None admin] PATH_INFO: `/v3/users/0450b2f70e844181b874330903e25ed4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.873810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac7cbd-79e7-4d23-993e-365e9fc24e8d None admin] RBAC: Authorizing `identity:get_user(user_id=0450b2f70e844181b874330903e25ed4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:29.874255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 168/342] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:29.875305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac7cbd-79e7-4d23-993e-365e9fc24e8d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:29.878670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 175/343] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:11:29 2022] GET /identity/v3/users/0450b2f70e844181b874330903e25ed4 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:29.879632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bec589-87f3-4c69-9c5f-059a2a5bba58 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.879902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05cf43-b866-4b8c-9c1e-d2a5de904a7c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:29.880006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bec589-87f3-4c69-9c5f-059a2a5bba58 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.880192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bec589-87f3-4c69-9c5f-059a2a5bba58 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.880657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05cf43-b866-4b8c-9c1e-d2a5de904a7c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:29.881165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05cf43-b866-4b8c-9c1e-d2a5de904a7c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:29.881455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 176/344] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:29.882953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bec589-87f3-4c69-9c5f-059a2a5bba58 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:29.883353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 169/345] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:29.884362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05cf43-b866-4b8c-9c1e-d2a5de904a7c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.030089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05cf43-b866-4b8c-9c1e-d2a5de904a7c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.033709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bec589-87f3-4c69-9c5f-059a2a5bba58 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.036696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.069274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9ccec-a6eb-4c45-b6d7-12ef6087334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.069928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ccec-a6eb-4c45-b6d7-12ef6087334f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.070210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ccec-a6eb-4c45-b6d7-12ef6087334f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.070489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ccec-a6eb-4c45-b6d7-12ef6087334f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.085269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1109f-de77-4fdd-97a4-a16fc5ce27c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.086286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1109f-de77-4fdd-97a4-a16fc5ce27c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.086803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1109f-de77-4fdd-97a4-a16fc5ce27c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.087088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1109f-de77-4fdd-97a4-a16fc5ce27c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.088080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1109f-de77-4fdd-97a4-a16fc5ce27c5 None admin] RBAC: Adding query filter params (role.id=07579953b0b047439d17ec419622f802, user.id=0450b2f70e844181b874330903e25ed4, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:30.088397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1109f-de77-4fdd-97a4-a16fc5ce27c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:30.090403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1109f-de77-4fdd-97a4-a16fc5ce27c5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:30.092835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.104823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 177/346] 10.222.0.87 () {56 vars in 1308 bytes} [Wed Jul 20 15:11:29 2022] GET /identity/v3/role_assignments?user.id=0450b2f70e844181b874330903e25ed4&scope.system=all&role.id=07579953b0b047439d17ec419622f802 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:30.105982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9e4fe-e20e-4791-9ec6-452e2b9f737b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.107431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9e4fe-e20e-4791-9ec6-452e2b9f737b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.107723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9e4fe-e20e-4791-9ec6-452e2b9f737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.125578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-55b9e4fe-e20e-4791-9ec6-452e2b9f737b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:30.126829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-55b9e4fe-e20e-4791-9ec6-452e2b9f737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:30.166543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9ccec-a6eb-4c45-b6d7-12ef6087334f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:30.168547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9ccec-a6eb-4c45-b6d7-12ef6087334f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:30.222799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 178/347] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:30.224633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d457-ef4c-4f39-9162-ad1b0e047b7c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.225128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d457-ef4c-4f39-9162-ad1b0e047b7c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.225627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d457-ef4c-4f39-9162-ad1b0e047b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.257687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d2e7d457-ef4c-4f39-9162-ad1b0e047b7c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:30.259297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d2e7d457-ef4c-4f39-9162-ad1b0e047b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:30.303625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 170/348] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:30.305380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440a9d-37e7-46b8-ba69-2c35d91177a0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.305673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440a9d-37e7-46b8-ba69-2c35d91177a0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.305945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440a9d-37e7-46b8-ba69-2c35d91177a0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.311374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 171/349] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:30.312327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2440a9d-37e7-46b8-ba69-2c35d91177a0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.348126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 179/350] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:30.348814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d457-ef4c-4f39-9162-ad1b0e047b7c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.371209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.382985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.443339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2440a9d-37e7-46b8-ba69-2c35d91177a0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.490009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdacf2-c832-41ce-b076-c4690170db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.493224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdacf2-c832-41ce-b076-c4690170db84 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.493224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdacf2-c832-41ce-b076-c4690170db84 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.493224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdacf2-c832-41ce-b076-c4690170db84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.494119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d457-ef4c-4f39-9162-ad1b0e047b7c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.512994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdacf2-c832-41ce-b076-c4690170db84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-edbdacf2-c832-41ce-b076-c4690170db84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:30.522246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:30.523222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:30.524037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 172/351] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:30.524707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c115b4b-26b1-4020-8b71-fdc054709a61 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.525462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c115b4b-26b1-4020-8b71-fdc054709a61 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.525462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c115b4b-26b1-4020-8b71-fdc054709a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.543268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2c115b4b-26b1-4020-8b71-fdc054709a61 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:30.544479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2c115b4b-26b1-4020-8b71-fdc054709a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:30.549245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.550244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.550589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.550908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.552135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:30.553599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:30.555370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 180/352] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:30 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:30.556131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.642745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 173/353] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:30.642745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c115b4b-26b1-4020-8b71-fdc054709a61 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.684663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.686419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.699073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8768008-50ec-4c2a-94ed-8c966530b7b7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.744141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.744968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.745254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.745532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.765014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:30.772747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c115b4b-26b1-4020-8b71-fdc054709a61 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:30.773863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:30.774858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:30.775682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:30.778384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 181/354] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:30.778384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.813517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.814181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.815590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.815897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.817024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:30.817024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:30.818238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:30.827350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 174/355] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:30.828176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.902603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad1245-d959-4c17-a022-d4f94fc1aecf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.938975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f385240-7dda-4bff-89e9-de427b5fc5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.939856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f385240-7dda-4bff-89e9-de427b5fc5ce None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.940203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f385240-7dda-4bff-89e9-de427b5fc5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.940503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f385240-7dda-4bff-89e9-de427b5fc5ce None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.946858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f385240-7dda-4bff-89e9-de427b5fc5ce None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:30.947892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.948325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f385240-7dda-4bff-89e9-de427b5fc5ce None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:30.950483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 182/356] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:30 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:30.950883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90612c3-774f-4b00-8fbe-787f4e8c5dad None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:30.951307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1372-6b1a-4189-bfd1-acee16e846cc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.951597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1372-6b1a-4189-bfd1-acee16e846cc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.951876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1372-6b1a-4189-bfd1-acee16e846cc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:30.953239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 183/357] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:30.953841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1372-6b1a-4189-bfd1-acee16e846cc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:30.977247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:30.991975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:30.992692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:30.992978 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:30.993258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.004445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:31.012513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:31.013493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:31.014361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:31.018845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 175/358] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:31.019808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:31.088886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1372-6b1a-4189-bfd1-acee16e846cc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.129677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:31.131304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.131304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.131500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.132926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:31.132926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:31.133920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:31.138135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1578-b92f-413d-bb2b-d0e5f87e0246 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.143925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 184/359] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:31.149181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:31.184592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:31.185174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.185459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.185739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.222682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:31.241829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:31.267636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb1c00-83e1-4c7e-be3b-64c6e5349652 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.275685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:31.277164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:31.308141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd4eed-c410-47f3-8c29-c243b9e980c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:31.309105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd4eed-c410-47f3-8c29-c243b9e980c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.309589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd4eed-c410-47f3-8c29-c243b9e980c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.310060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd4eed-c410-47f3-8c29-c243b9e980c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.310942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd4eed-c410-47f3-8c29-c243b9e980c2 None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=c887c09296934553842076fabeae9c40) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:31.311263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd4eed-c410-47f3-8c29-c243b9e980c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:31.313824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd4eed-c410-47f3-8c29-c243b9e980c2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:31.320263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 185/360] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=c887c09296934553842076fabeae9c40&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:31.321347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818fe2-e0b7-4ee1-8ef1-ff2721e31b9a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.321639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818fe2-e0b7-4ee1-8ef1-ff2721e31b9a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.321918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818fe2-e0b7-4ee1-8ef1-ff2721e31b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.344095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-90818fe2-e0b7-4ee1-8ef1-ff2721e31b9a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:31.346267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90818fe2-e0b7-4ee1-8ef1-ff2721e31b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:31.413575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 176/361] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:31.414591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:31.433002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 186/362] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:31.434696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90818fe2-e0b7-4ee1-8ef1-ff2721e31b9a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:31.510763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:31.538947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:31.569593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2dfe-9473-474c-a2a3-7224429bf5f2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.580621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90818fe2-e0b7-4ee1-8ef1-ff2721e31b9a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.615356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:31.615754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.616040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.616319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.617155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:31.617379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:31.618807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:31.627196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:31.627793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 177/363] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:31.627904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.627904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.629099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.629208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:31.711777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:31.713303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:31.738935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235da06-29e1-47c8-a2e7-42532c9e8827 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.772870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:31.786058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:31.786277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.786552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.787326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.788341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:31.789925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:31.791857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 178/364] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:31.793003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:31.797182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:31.841432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 187/365] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:31.842230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:31.921736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d4a8-13bd-4f2e-a549-3ab3576b17bf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.970398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:31.971504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b47b0-a5c0-400a-884b-1835e02ec598 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:31.972303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:31.972952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:31.972952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:31.986325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:31.996374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:31.997302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:31.998103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 179/366] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:31.998789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.027149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.028119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.028586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.029041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.062619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.081528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.123373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.126573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.126776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8129-512d-43e9-876e-4b36aee0cfd4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.171024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.171024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.171024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.171024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.172663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.174104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.176389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 180/367] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:32.177170 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.260850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 188/368] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:32.261630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.315579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe69b-4a10-45f1-9b01-2cfa492edbc8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.337878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.349285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.355865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.356777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.357054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.357328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.358508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.360033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.361862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 181/369] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:32.363859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.386500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc449b3-8b1b-4a10-b282-044cfb317e2c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.423801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.424516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.425372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.425654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.426403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:32.426740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.428117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.436777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 189/370] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:32.437609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.476441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a6d3b-7f3f-4f96-ab93-4859b69ca21f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.516396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.517065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.517353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.517634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.518544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=849a77e1da2d492b8607d4299a26579d) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:32.518899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.520342 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.525904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 182/371] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:32.526719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.566418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c91f-5331-4b46-95d0-40d74b63b608 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.594346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.609277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.614993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.615886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.619553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.619553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.619553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.619553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.621300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 190/372] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:32.622128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.658574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc25e4-337a-4bd7-8517-5aed2b2aa94f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.703807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.704864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.705159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.705438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.707909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.709371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.711438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 183/373] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:32.712219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.764557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb171652-6fa1-4670-a0e7-4eaf6b525f8a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.811687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.813379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.814142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.814685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.819666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee7940-08bd-4501-bd15-6e752baed8d3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:32.839170 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.859920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:32.860867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:32.861154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:32.861432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:32.862773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.865226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.867255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 184/374] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:32.868110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:32.901791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:32.905259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:32.907094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:32.977987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682832-dc19-4bb2-bbff-994ef030fab5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:33.013110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:33.013823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.014110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.014388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.015312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=c887c09296934553842076fabeae9c40) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:33.015571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:33.017018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:33.024045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 185/375] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=c887c09296934553842076fabeae9c40&role.id=1a4d2011cce6457b9a1d4462800949db => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:33.024906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 191/376] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:33.029631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:33.030993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:33.085318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:33.141601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d58c6-a294-4caf-b537-b568a7080295 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:33.151455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:33.155721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f248ad-ae10-42fe-bb50-50a3a89c8ec8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:33.180097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:33.180803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.181038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.181314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.182151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=849a77e1da2d492b8607d4299a26579d) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:33.182466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:33.184048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:33.191762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 186/377] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:33 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=1a4d2011cce6457b9a1d4462800949db => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:33.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:33.203172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.203608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.204033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] PATH_INFO: `/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.205560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] RBAC: Authorizing `identity:get_project(project_id=f094b507fc2a4226a1c6a63fcbb399b2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:33.207821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:33.210228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 192/378] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:33 2022] GET /identity/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:33.215791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:33.367802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc3699-d521-4093-bf4e-b73ea2b926a2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:33.383851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:33.404415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3fd49-6d6c-49da-afe5-684d9f57de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:33.405286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3fd49-6d6c-49da-afe5-684d9f57de11 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.405564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3fd49-6d6c-49da-afe5-684d9f57de11 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.405834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3fd49-6d6c-49da-afe5-684d9f57de11 None admin] PATH_INFO: `/v3/groups/6b3c299e4ce24565b2a9275d7ad2f0e3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.412678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3fd49-6d6c-49da-afe5-684d9f57de11 None admin] RBAC: Authorizing `identity:get_group(group_id=6b3c299e4ce24565b2a9275d7ad2f0e3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:33.414185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3fd49-6d6c-49da-afe5-684d9f57de11 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:33.416199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 187/379] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:33 2022] GET /identity/v3/groups/6b3c299e4ce24565b2a9275d7ad2f0e3 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:33.421983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:33.495554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027db-784a-4a96-a6e3-1995a8336f93 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.495899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027db-784a-4a96-a6e3-1995a8336f93 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.496190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027db-784a-4a96-a6e3-1995a8336f93 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.498074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 188/380] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:33.504062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939ec8-6198-4fd4-95d0-664791035531 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.504225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939ec8-6198-4fd4-95d0-664791035531 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.504400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939ec8-6198-4fd4-95d0-664791035531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.526804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a1939ec8-6198-4fd4-95d0-664791035531 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:33.528312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a1939ec8-6198-4fd4-95d0-664791035531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:33.611241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9573058-0568-419a-8811-a093c9f55d70 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:33.653997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 189/381] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:33.678164 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:33.678867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.678976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939ec8-6198-4fd4-95d0-664791035531 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:33.679174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.679419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.680263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] RBAC: Adding query filter params (group.id=6b3c299e4ce24565b2a9275d7ad2f0e3, role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=f094b507fc2a4226a1c6a63fcbb399b2) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:33.680575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:33.682142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:33.695075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 193/382] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:33 2022] GET /identity/v3/role_assignments?group.id=6b3c299e4ce24565b2a9275d7ad2f0e3&scope.project.id=f094b507fc2a4226a1c6a63fcbb399b2&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:33.816356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939ec8-6198-4fd4-95d0-664791035531 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:33.834349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:33.871050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:33.871867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:33.872150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:33.872427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:33.887763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:33.897651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:33.898601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:33.899506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 190/383] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:33.907798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:33.971752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:34.079264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8fb65-1bc7-40b6-ad25-7aa2e0995232 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:34.124683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:34.125356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:34.125637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:34.125912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:34.126667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:34.126984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:34.129618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:34.142727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 194/384] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:34.144088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:34.310875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9ed64-957d-40b1-8fc3-7855bdb3f236 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:34.355520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:34.356380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:34.356661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:34.356937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:34.363341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:34.364822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:34.366843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 191/385] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:34 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:34.372338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:34.524888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:34.535842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c1bdc-8aaa-4272-bcd1-6433f1d88e31 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:34.587576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65889e-8280-419f-9f2a-e12445164dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:34.588449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65889e-8280-419f-9f2a-e12445164dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:34.588732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65889e-8280-419f-9f2a-e12445164dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:34.589008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65889e-8280-419f-9f2a-e12445164dd6 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:34.595378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65889e-8280-419f-9f2a-e12445164dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:34.597366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65889e-8280-419f-9f2a-e12445164dd6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:34.599724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 195/386] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:34 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:34.605364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:34.652631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:34.726676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90e634-92cf-41ea-b92e-424c2829a2fd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:34.770362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01849b0-b4e6-492e-ac63-1f0b6cbaf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:34.771311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01849b0-b4e6-492e-ac63-1f0b6cbaf72c None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:34.771598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01849b0-b4e6-492e-ac63-1f0b6cbaf72c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:34.771880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01849b0-b4e6-492e-ac63-1f0b6cbaf72c None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40/groups/95851e6f719046f7bb8715af3f2102b2/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:34.773989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01849b0-b4e6-492e-ac63-1f0b6cbaf72c None admin] RBAC: Authorizing `identity:create_grant(project_id=c887c09296934553842076fabeae9c40, group_id=95851e6f719046f7bb8715af3f2102b2, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:34.775516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01849b0-b4e6-492e-ac63-1f0b6cbaf72c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:34.897176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 192/387] 10.222.0.87 () {58 vars in 1442 bytes} [Wed Jul 20 15:11:34 2022] PUT /identity/v3/projects/c887c09296934553842076fabeae9c40/groups/95851e6f719046f7bb8715af3f2102b2/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:34.964488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8622f4-c4cd-468f-8b0a-8fe130a3389d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:34.964844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8622f4-c4cd-468f-8b0a-8fe130a3389d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:34.965064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8622f4-c4cd-468f-8b0a-8fe130a3389d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:34.966822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 196/388] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:34.972695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112b8b-549f-4acf-b3f3-7f6e81e24569 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:34.975705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112b8b-549f-4acf-b3f3-7f6e81e24569 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:34.975705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1112b8b-549f-4acf-b3f3-7f6e81e24569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.003864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a1112b8b-549f-4acf-b3f3-7f6e81e24569 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:35.005116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a1112b8b-549f-4acf-b3f3-7f6e81e24569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:35.097220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 193/389] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:35.121843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8622f4-c4cd-468f-8b0a-8fe130a3389d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:35.260709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8622f4-c4cd-468f-8b0a-8fe130a3389d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:35.307568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:35.308377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:35.308664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:35.308944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.325457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:35.333419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:35.334389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:35.335270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 197/390] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:35.340558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1112b8b-549f-4acf-b3f3-7f6e81e24569 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:35.377064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:35.459983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1112b8b-549f-4acf-b3f3-7f6e81e24569 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:35.507977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:35.508667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:35.508951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:35.509231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.509999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:35.510559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:35.512038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:35.522604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 194/391] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:35.528251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:35.575347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:35.675269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73875-8de5-425d-ac0e-033ff96e9c88 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:35.732333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae3d73-3c90-4668-8220-55ae5b642b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:35.733205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3d73-3c90-4668-8220-55ae5b642b4c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:35.733482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3d73-3c90-4668-8220-55ae5b642b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:35.733752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae3d73-3c90-4668-8220-55ae5b642b4c None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.734954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae3d73-3c90-4668-8220-55ae5b642b4c None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:35.736396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae3d73-3c90-4668-8220-55ae5b642b4c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:35.743451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 198/392] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:35 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:35.744823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:35.859790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:35.878716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5297c66-1950-4f3b-95b4-ed0f2e384470 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:35.911470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e486-5960-459d-b162-0792bc4db4b1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:35.913025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e486-5960-459d-b162-0792bc4db4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:35.913307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1e486-5960-459d-b162-0792bc4db4b1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.914936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 199/393] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:35.920343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9cec-40aa-493f-ba17-57acd234ab19 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:35.920638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9cec-40aa-493f-ba17-57acd234ab19 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:35.920922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be9cec-40aa-493f-ba17-57acd234ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.925186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8a6b-d345-4178-9bde-2c4969295439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:35.926063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8a6b-d345-4178-9bde-2c4969295439 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:35.926346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8a6b-d345-4178-9bde-2c4969295439 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:35.926623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8a6b-d345-4178-9bde-2c4969295439 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.930434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b8a6b-d345-4178-9bde-2c4969295439 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:35.931941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b8a6b-d345-4178-9bde-2c4969295439 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:35.939420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 195/394] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:35 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:35.941757 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201de70-6877-4db3-bcba-95192dc62d47 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:35.942052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201de70-6877-4db3-bcba-95192dc62d47 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:35.942335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201de70-6877-4db3-bcba-95192dc62d47 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:35.943971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 196/395] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:11:35.945979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-52be9cec-40aa-493f-ba17-57acd234ab19 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:35.947472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201de70-6877-4db3-bcba-95192dc62d47 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:35.947607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-52be9cec-40aa-493f-ba17-57acd234ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:36.026908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 200/396] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:36.028285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471c5d-8b1a-4101-9834-9718d0a6941e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.028578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471c5d-8b1a-4101-9834-9718d0a6941e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.028858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471c5d-8b1a-4101-9834-9718d0a6941e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.061002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b2471c5d-8b1a-4101-9834-9718d0a6941e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:36.062208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b2471c5d-8b1a-4101-9834-9718d0a6941e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:36.077612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:36.081527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201de70-6877-4db3-bcba-95192dc62d47 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.132684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:36.134156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.134442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.134752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d/groups/95851e6f719046f7bb8715af3f2102b2/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.137277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] RBAC: Authorizing `identity:create_grant(project_id=849a77e1da2d492b8607d4299a26579d, group_id=95851e6f719046f7bb8715af3f2102b2, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:36.138840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:36.146969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 201/397] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:36.147881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2471c5d-8b1a-4101-9834-9718d0a6941e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.193178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 197/398] 10.222.0.87 () {58 vars in 1442 bytes} [Wed Jul 20 15:11:35 2022] PUT /identity/v3/projects/849a77e1da2d492b8607d4299a26579d/groups/95851e6f719046f7bb8715af3f2102b2/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:36.193818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.218468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:36.271112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2471c5d-8b1a-4101-9834-9718d0a6941e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.321630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc923e64-d015-4ef1-941a-3ab4db16be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:36.323715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923e64-d015-4ef1-941a-3ab4db16be47 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.324750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923e64-d015-4ef1-941a-3ab4db16be47 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.325246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc923e64-d015-4ef1-941a-3ab4db16be47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.335246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a089697-5425-48df-9fd2-da27f709784b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.343647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc923e64-d015-4ef1-941a-3ab4db16be47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fc923e64-d015-4ef1-941a-3ab4db16be47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:36.356036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:36.356928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:36.357715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:36.358920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 202/399] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:36.360307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bc3eb-2f5e-4a7c-811b-958e3efcef03 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.360307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bc3eb-2f5e-4a7c-811b-958e3efcef03 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.360307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bc3eb-2f5e-4a7c-811b-958e3efcef03 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.361768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 203/400] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:36.363780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bc3eb-2f5e-4a7c-811b-958e3efcef03 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.386085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:36.391801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aacdaa-2eb1-403d-8691-de2f38b856b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:36.392762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aacdaa-2eb1-403d-8691-de2f38b856b5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.393750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aacdaa-2eb1-403d-8691-de2f38b856b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.394166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aacdaa-2eb1-403d-8691-de2f38b856b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.408695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aacdaa-2eb1-403d-8691-de2f38b856b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d1aacdaa-2eb1-403d-8691-de2f38b856b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:36.421018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:36.421939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:36.423279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 198/401] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:36.429433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e972-73e5-4afb-9e65-5fa939f4271f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.429729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e972-73e5-4afb-9e65-5fa939f4271f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.430012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e972-73e5-4afb-9e65-5fa939f4271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.450025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2de6e972-73e5-4afb-9e65-5fa939f4271f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:36.451247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2de6e972-73e5-4afb-9e65-5fa939f4271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:36.504997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bc3eb-2f5e-4a7c-811b-958e3efcef03 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.523914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 199/402] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:36.524778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6e972-73e5-4afb-9e65-5fa939f4271f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.535097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:36.568199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:36.569008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.571742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.571742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.571742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:36.571742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:36.572702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:36.589042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 204/403] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:36.590566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.634781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6e972-73e5-4afb-9e65-5fa939f4271f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.681396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:36.682357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.682738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.683088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.684538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:36.684662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:36.686110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:36.687661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:36.697972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 200/404] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:36.703499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.732519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96134-61ed-4811-bb47-4490b1b28c2f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.779961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:36.781062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.781394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.781675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.788450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:36.801496 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:36.811531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:36.812434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:36.813224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 205/405] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:36.819508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.834482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cb352-8479-4445-a7a1-89184da4c192 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.876181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:36.877419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:36.878796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:36.879281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:36.880714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:36.882379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:36.884818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 201/406] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:36.886132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:36.975878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bc285-8a25-464b-9eb5-533fb0c4ea41 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:36.997152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275154-8688-45b6-b150-a0b9f53c4a6d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.017718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:37.025124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.027155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.027155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.027155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.028475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.030456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.037444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 206/407] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:37.037444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.041532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.043500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.043820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.044599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.045366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:37.045677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.047086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.050161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:37.065642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 202/408] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:37.065642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.173530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718fdfd-8822-486d-9354-16b17adc83e7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.178225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab50a-dd5f-4409-be43-9787c151a4c0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.214765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.216000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.216590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.217143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.218928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.219961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.220893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.221075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.221431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.221893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.223210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.224095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 207/409] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:37 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:37.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.225318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.231318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 203/410] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:37 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:37.231318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.306833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:37.322682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:37.350892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884494b8-33ea-4310-a925-3686f267ca5a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.367058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03ab59-898e-47ab-a29d-a135749c4c76 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.390913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.392164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.393139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.393653 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40/groups/95851e6f719046f7bb8715af3f2102b2/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.396269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] RBAC: Authorizing `identity:create_grant(project_id=c887c09296934553842076fabeae9c40, group_id=95851e6f719046f7bb8715af3f2102b2, role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.399112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.407736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.408609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.409461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.409747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] PATH_INFO: `/v3/groups/6b3c299e4ce24565b2a9275d7ad2f0e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.410974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] RBAC: Authorizing `identity:get_group(group_id=6b3c299e4ce24565b2a9275d7ad2f0e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.412486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.414380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 208/411] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:37 2022] GET /identity/v3/groups/6b3c299e4ce24565b2a9275d7ad2f0e3 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:37.415780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.516451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2b2d-4252-4998-801c-5c4170060996 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.517328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 204/412] 10.222.0.87 () {58 vars in 1442 bytes} [Wed Jul 20 15:11:37 2022] PUT /identity/v3/projects/c887c09296934553842076fabeae9c40/groups/95851e6f719046f7bb8715af3f2102b2/roles/1a4d2011cce6457b9a1d4462800949db => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:11:37.527739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.559941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f7769-909f-4e45-82b0-ed8a4a6ec44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.560955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f7769-909f-4e45-82b0-ed8a4a6ec44a None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.561238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f7769-909f-4e45-82b0-ed8a4a6ec44a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.561514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f7769-909f-4e45-82b0-ed8a4a6ec44a None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d/groups/95851e6f719046f7bb8715af3f2102b2/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.564045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f7769-909f-4e45-82b0-ed8a4a6ec44a None admin] RBAC: Authorizing `identity:create_grant(project_id=849a77e1da2d492b8607d4299a26579d, group_id=95851e6f719046f7bb8715af3f2102b2, role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.565795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f7769-909f-4e45-82b0-ed8a4a6ec44a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.570027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:37.668016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 209/413] 10.222.0.87 () {58 vars in 1442 bytes} [Wed Jul 20 15:11:37 2022] PUT /identity/v3/projects/849a77e1da2d492b8607d4299a26579d/groups/95851e6f719046f7bb8715af3f2102b2/roles/1a4d2011cce6457b9a1d4462800949db => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:37.668992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5868f-9d3e-4562-ad6a-6f5849d9d106 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.669765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becf5e-5488-4f5c-83bc-c6b40637ab47 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.670147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becf5e-5488-4f5c-83bc-c6b40637ab47 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.670501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24becf5e-5488-4f5c-83bc-c6b40637ab47 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.672211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 210/414] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:37.679100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147378b0-d1ef-4352-8bf2-b60d4a4ccc8c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.682920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147378b0-d1ef-4352-8bf2-b60d4a4ccc8c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.682920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147378b0-d1ef-4352-8bf2-b60d4a4ccc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.699372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-147378b0-d1ef-4352-8bf2-b60d4a4ccc8c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:37.700982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-147378b0-d1ef-4352-8bf2-b60d4a4ccc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:37.709631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:37.722823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.723096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.724255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.724540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] PATH_INFO: `/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.726456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] RBAC: Authorizing `identity:get_project(project_id=f094b507fc2a4226a1c6a63fcbb399b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.728497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.730726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 205/415] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:37 2022] GET /identity/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:37.736977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.810548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 211/416] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:37.838352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147378b0-d1ef-4352-8bf2-b60d4a4ccc8c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:37.899778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5452-fea0-4e00-9cc7-a0b043a58b92 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.945476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.946855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.947355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.947850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] PATH_INFO: `/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2/groups/6b3c299e4ce24565b2a9275d7ad2f0e3/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:37.950684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] RBAC: Authorizing `identity:create_grant(project_id=f094b507fc2a4226a1c6a63fcbb399b2, group_id=6b3c299e4ce24565b2a9275d7ad2f0e3, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:37.952567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:37.952692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147378b0-d1ef-4352-8bf2-b60d4a4ccc8c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:37.983061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:37.992591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:37.993405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:37.993684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:37.994001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.005667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:38.018008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:38.019907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:38.020970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 212/417] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:38.022677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:38.045186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 206/418] 10.222.0.87 () {58 vars in 1442 bytes} [Wed Jul 20 15:11:37 2022] PUT /identity/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2/groups/6b3c299e4ce24565b2a9275d7ad2f0e3/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:11:38.153565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96bcea-3b61-4f1c-996e-9d39de1c11f0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:38.192267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b3265-5779-4d48-85e4-95e92a7739f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:38.192962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b3265-5779-4d48-85e4-95e92a7739f8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:38.193242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b3265-5779-4d48-85e4-95e92a7739f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:38.193517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b3265-5779-4d48-85e4-95e92a7739f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.194284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b3265-5779-4d48-85e4-95e92a7739f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:38.194588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b3265-5779-4d48-85e4-95e92a7739f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:38.196020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b3265-5779-4d48-85e4-95e92a7739f8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:38.206157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 213/419] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:38.212267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:38.294070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:38.345376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037f06-112a-4617-b45c-21fe2d7956cc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:38.382430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:38.383125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:38.383411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:38.383687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.431241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f68862-5c92-43d3-b8e1-c2ac505d0a59 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:38.431431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f68862-5c92-43d3-b8e1-c2ac505d0a59 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:38.431709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f68862-5c92-43d3-b8e1-c2ac505d0a59 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.434311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 214/420] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:11:38.438300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a315-5fec-4083-aaab-62b64816afd4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:38.438587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a315-5fec-4083-aaab-62b64816afd4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:38.438915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a315-5fec-4083-aaab-62b64816afd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.458557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0ed2a315-5fec-4083-aaab-62b64816afd4 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:38.459816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ed2a315-5fec-4083-aaab-62b64816afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:38.481451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:38.483684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:38.546983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:38.581710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:38.608069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 215/421] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:38.633055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2a315-5fec-4083-aaab-62b64816afd4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:38.648306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 207/422] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:38.653969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:38.740564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2a315-5fec-4083-aaab-62b64816afd4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:38.776868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:38.777658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:38.777937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:38.778208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.789041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:38.796670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:38.797722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:38.798671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 216/423] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:38.805022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:38.853092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a1b77-86bb-4a4c-b0f8-8669fb23c56b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:38.859706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:38.920454 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81eed7-ab15-4247-9a55-18fc69560064 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:38.927350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:38.928227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:38.928509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:38.928788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.930042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:38.931574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:38.933690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 208/424] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:38 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:38.938749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:38.958419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:38.959222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:38.959502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:38.959776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:38.960596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:38.960908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:38.962295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:38.976634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 217/425] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:38.978041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:38.992036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:39.102081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb77d93-7dad-40a1-9fa9-e01d3c40b767 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:39.133473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:39.139698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:39.140724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:39.141015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:39.141295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:39.142521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:39.143088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc57f2-caa8-44b1-9267-1119e675d7c3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:39.144249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:39.146461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 209/426] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:38 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:39.152379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:39.259462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:39.260049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:39.260583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:39.260865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:39.269681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:39.275316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67cc44-da39-4c4b-ac7c-9d9625a47511 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:39.312646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:39.313305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:39.313589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:39.313866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:39.314722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=c887c09296934553842076fabeae9c40) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:39.315450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:39.317087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:39.324449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 210/427] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:39 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=c887c09296934553842076fabeae9c40&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:39.376732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:39.378909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:39.482191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:39.486139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 218/428] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:11:39.493800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:39.636809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f291db-9f57-4670-baa6-e377456b639a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:39.676344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:39.677214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:39.677496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:39.677769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:39.679003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:39.680450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:39.682466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 211/429] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:39 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:39.687865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:39.792973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58d65d-89ed-4259-b74c-1fec1ec686f0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:39.829219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5965dc-3273-41cf-b8a9-1f2fc784394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:39.830085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5965dc-3273-41cf-b8a9-1f2fc784394d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:39.830370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5965dc-3273-41cf-b8a9-1f2fc784394d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:39.831512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5965dc-3273-41cf-b8a9-1f2fc784394d None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:39.832461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5965dc-3273-41cf-b8a9-1f2fc784394d None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:39.833995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5965dc-3273-41cf-b8a9-1f2fc784394d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:39.836062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 219/430] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:39 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:39.841615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:39.876024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:39.970564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ac5-9296-4127-a20c-050dea139846 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:40.009537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73249ef1-5bae-4309-8333-aa0bb7078d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:40.010196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249ef1-5bae-4309-8333-aa0bb7078d8c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.010763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249ef1-5bae-4309-8333-aa0bb7078d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.011041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249ef1-5bae-4309-8333-aa0bb7078d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.011872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73249ef1-5bae-4309-8333-aa0bb7078d8c None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=6ad1c431efee442b8f305d707b3adc85, scope.project.id=849a77e1da2d492b8607d4299a26579d) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:40.012181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73249ef1-5bae-4309-8333-aa0bb7078d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:40.013605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73249ef1-5bae-4309-8333-aa0bb7078d8c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:40.024595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 212/431] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:39 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=6ad1c431efee442b8f305d707b3adc85 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:40.167931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e53ba-d7e0-4d13-884c-79434b1e02db None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.168312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e53ba-d7e0-4d13-884c-79434b1e02db None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.168509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e53ba-d7e0-4d13-884c-79434b1e02db None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.170205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 220/432] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:40.176672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59a9c-6432-445e-b1ef-0e2aa25f87df None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.176961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59a9c-6432-445e-b1ef-0e2aa25f87df None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.177240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba59a9c-6432-445e-b1ef-0e2aa25f87df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.200501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9ba59a9c-6432-445e-b1ef-0e2aa25f87df None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:40.201693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9ba59a9c-6432-445e-b1ef-0e2aa25f87df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:40.223414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246ff3-315f-42f8-9e5b-3d20c390d976 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.223724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246ff3-315f-42f8-9e5b-3d20c390d976 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.223982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246ff3-315f-42f8-9e5b-3d20c390d976 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.225525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 221/433] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:40.231356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f023f4e-69cf-46cf-94bb-7d9421e3a25a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.231734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f023f4e-69cf-46cf-94bb-7d9421e3a25a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.231922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f023f4e-69cf-46cf-94bb-7d9421e3a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.252120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2f023f4e-69cf-46cf-94bb-7d9421e3a25a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:40.254953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2f023f4e-69cf-46cf-94bb-7d9421e3a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:40.290679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 213/434] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:40.312148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59a9c-6432-445e-b1ef-0e2aa25f87df None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:40.336203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:40.342347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:40.350340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 222/435] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:40.374743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f023f4e-69cf-46cf-94bb-7d9421e3a25a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:40.447946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba59a9c-6432-445e-b1ef-0e2aa25f87df None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:40.480575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f023f4e-69cf-46cf-94bb-7d9421e3a25a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:40.488325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:40.489814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.490327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.491182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.504454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:40.513583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:40.514693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:40.515552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 214/436] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:40.520773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:40.529807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:40.530954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.531240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.531512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.542458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:40.551305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:40.552214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:40.553315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 223/437] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:40.558356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:40.605284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:40.616477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:40.628658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb679d9b-ce51-4a54-9e7e-f2ee7541ba02 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:40.657699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edefb1d-1ad9-4251-92c8-3739cfeafd31 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:40.662545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04ee21-2472-47a8-8002-60e18df4bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:40.663242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04ee21-2472-47a8-8002-60e18df4bb61 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.663535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04ee21-2472-47a8-8002-60e18df4bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.663806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04ee21-2472-47a8-8002-60e18df4bb61 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.664556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04ee21-2472-47a8-8002-60e18df4bb61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:40.664861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04ee21-2472-47a8-8002-60e18df4bb61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:40.666248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04ee21-2472-47a8-8002-60e18df4bb61 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:40.674301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 215/438] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:40.676129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512b2c-8c1e-47c7-9a3c-b4c16ca0f6f0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.676413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512b2c-8c1e-47c7-9a3c-b4c16ca0f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.676692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91512b2c-8c1e-47c7-9a3c-b4c16ca0f6f0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.677931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 216/439] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:40.680458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91512b2c-8c1e-47c7-9a3c-b4c16ca0f6f0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:40.697159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b7a19-8e8c-474d-b6a0-bc75d1f5eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:40.697883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7a19-8e8c-474d-b6a0-bc75d1f5eb58 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.698233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7a19-8e8c-474d-b6a0-bc75d1f5eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.698450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7a19-8e8c-474d-b6a0-bc75d1f5eb58 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.699242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b7a19-8e8c-474d-b6a0-bc75d1f5eb58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:40.699547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b7a19-8e8c-474d-b6a0-bc75d1f5eb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:40.700910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b7a19-8e8c-474d-b6a0-bc75d1f5eb58 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:40.709718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 224/440] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:40.714300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7de4df-51a3-4d8d-bdd6-25dc4cc3d1be None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.714300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7de4df-51a3-4d8d-bdd6-25dc4cc3d1be None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.714300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7de4df-51a3-4d8d-bdd6-25dc4cc3d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.728256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2e7de4df-51a3-4d8d-bdd6-25dc4cc3d1be None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:40.729435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2e7de4df-51a3-4d8d-bdd6-25dc4cc3d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:40.780128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91512b2c-8c1e-47c7-9a3c-b4c16ca0f6f0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:40.796262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 225/441] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:40.798491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7de4df-51a3-4d8d-bdd6-25dc4cc3d1be None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:40.821522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:40.822174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.822457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.822772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.832005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:40.849165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:40.891125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:40.892585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:40.897767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7de4df-51a3-4d8d-bdd6-25dc4cc3d1be None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:40.932508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:40.933154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:40.933439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:40.933713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:40.991680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 217/442] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:11:40.992434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.005250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.006763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.031069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.055033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.090963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1f69-4c31-472b-981b-39ccc74fdf10 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.104518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 226/443] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:41.105329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.124288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.125076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.125353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.125629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.137009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:41.145450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:41.146376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:41.147201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 218/444] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:41.147885 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.203690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5be823-8462-4570-8f24-2fc436862905 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.238127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.239015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.239300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.239575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] PATH_INFO: `/v3/projects/c887c09296934553842076fabeae9c40` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.240764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c887c09296934553842076fabeae9c40)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.242263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.243926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 227/445] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/projects/c887c09296934553842076fabeae9c40 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:41.244673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.250307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.254472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b483b1c-20ec-409a-b729-7ed075785264 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.265438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.288858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.289703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.289986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.290260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] PATH_INFO: `/v3/projects/849a77e1da2d492b8607d4299a26579d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.291477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=849a77e1da2d492b8607d4299a26579d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.292934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.294621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 219/446] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/projects/849a77e1da2d492b8607d4299a26579d => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:41.295396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.345218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21d48b-5a48-4c11-882f-18f0b01a27a3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.380063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.380725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.381006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.381287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.382037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:41.382341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.383737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.391791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 228/447] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:41.392563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.400933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8106cab-12ce-4516-b8e8-0225402ce7d6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.435328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.436182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.436464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.436738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.437915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.439378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.441563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 220/448] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:41.442310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.472754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.475611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.492032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b2902-44da-49d8-b099-68007fcc6320 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.528556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.529339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.529627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.530009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] PATH_INFO: `/v3/groups/95851e6f719046f7bb8715af3f2102b2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.531118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] RBAC: Authorizing `identity:get_group(group_id=95851e6f719046f7bb8715af3f2102b2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.532580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.534408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 229/449] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/groups/95851e6f719046f7bb8715af3f2102b2 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:41.535031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.542992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a6e97-6546-458d-9da3-7a5687839466 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.577756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.578401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.578715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.579004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.633221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412f86a-052b-4223-9bba-c67ab2209ea1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.645764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.647270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.667730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.668370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.668651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.668920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.669739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=c887c09296934553842076fabeae9c40) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:41.670045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.671498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.677883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 230/450] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=c887c09296934553842076fabeae9c40&role.id=1a4d2011cce6457b9a1d4462800949db => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:41.678691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.679684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.695311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:41.767861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 221/451] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:41.773625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:41.798784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43b6b-c50f-4d7b-8e97-507573e6c7af None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.840980 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.841645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.841932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.842212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.843121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] RBAC: Adding query filter params (group.id=95851e6f719046f7bb8715af3f2102b2, role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=849a77e1da2d492b8607d4299a26579d) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:41.844296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.844992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.852728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 231/452] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/role_assignments?group.id=95851e6f719046f7bb8715af3f2102b2&scope.project.id=849a77e1da2d492b8607d4299a26579d&role.id=1a4d2011cce6457b9a1d4462800949db => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:41.903345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c508b34-ea25-4306-89a9-d431b42f06b5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:41.946592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:41.947847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:41.948347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:41.948931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] PATH_INFO: `/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:41.950366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] RBAC: Authorizing `identity:get_project(project_id=f094b507fc2a4226a1c6a63fcbb399b2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:41.951862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:41.953701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 222/453] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/projects/f094b507fc2a4226a1c6a63fcbb399b2 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:41.960869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:42.049131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:42.074773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64274-86e5-4c71-9ef4-69d028dd6554 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:42.118683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbceaa-0a5a-4d10-9ecf-764093216f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:42.119571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbceaa-0a5a-4d10-9ecf-764093216f82 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:42.119859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbceaa-0a5a-4d10-9ecf-764093216f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:42.120140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbceaa-0a5a-4d10-9ecf-764093216f82 None admin] PATH_INFO: `/v3/groups/6b3c299e4ce24565b2a9275d7ad2f0e3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:42.121324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbceaa-0a5a-4d10-9ecf-764093216f82 None admin] RBAC: Authorizing `identity:get_group(group_id=6b3c299e4ce24565b2a9275d7ad2f0e3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:42.122850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbceaa-0a5a-4d10-9ecf-764093216f82 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:42.124477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 232/454] 10.222.0.87 () {56 vars in 1180 bytes} [Wed Jul 20 15:11:41 2022] GET /identity/v3/groups/6b3c299e4ce24565b2a9275d7ad2f0e3 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:42.130423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:42.133303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:42.234605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff92d9-f9b6-4024-85c8-6375a1b380cd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:42.270472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bd2a6-b7ec-45d5-b2cd-7b3e9b8a7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:42.271166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd2a6-b7ec-45d5-b2cd-7b3e9b8a7b1c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:42.271449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd2a6-b7ec-45d5-b2cd-7b3e9b8a7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:42.271727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bd2a6-b7ec-45d5-b2cd-7b3e9b8a7b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:42.272566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bd2a6-b7ec-45d5-b2cd-7b3e9b8a7b1c None admin] RBAC: Adding query filter params (group.id=6b3c299e4ce24565b2a9275d7ad2f0e3, role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=f094b507fc2a4226a1c6a63fcbb399b2) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:42.272884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bd2a6-b7ec-45d5-b2cd-7b3e9b8a7b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:42.274340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bd2a6-b7ec-45d5-b2cd-7b3e9b8a7b1c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:42.280259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 223/455] 10.222.0.87 () {56 vars in 1376 bytes} [Wed Jul 20 15:11:42 2022] GET /identity/v3/role_assignments?group.id=6b3c299e4ce24565b2a9275d7ad2f0e3&scope.project.id=f094b507fc2a4226a1c6a63fcbb399b2&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:44.830171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2a211-aa61-4ca3-8fb4-6d96a8bacf03 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:44.831766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2a211-aa61-4ca3-8fb4-6d96a8bacf03 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:44.832278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2a211-aa61-4ca3-8fb4-6d96a8bacf03 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:44.834917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 233/456] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:44.839290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8353d0-ef9c-4e7b-89a6-fb72e744b976 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:44.845559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8353d0-ef9c-4e7b-89a6-fb72e744b976 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:44.845559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8353d0-ef9c-4e7b-89a6-fb72e744b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:44.863184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6d8353d0-ef9c-4e7b-89a6-fb72e744b976 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:44.864451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6d8353d0-ef9c-4e7b-89a6-fb72e744b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:44.928117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:44.942849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 224/457] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:44.978890 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2a211-aa61-4ca3-8fb4-6d96a8bacf03 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.027994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f9c4-8c01-49a0-bb4a-8a8313478ef5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.028633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f9c4-8c01-49a0-bb4a-8a8313478ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.029113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494f9c4-8c01-49a0-bb4a-8a8313478ef5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.031308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 225/458] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:45.036260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1914b-9122-40ac-ad44-2c0029a49485 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.036824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1914b-9122-40ac-ad44-2c0029a49485 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.037325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1914b-9122-40ac-ad44-2c0029a49485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.064240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c6e1914b-9122-40ac-ad44-2c0029a49485 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:45.065974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c6e1914b-9122-40ac-ad44-2c0029a49485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:45.124899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2a211-aa61-4ca3-8fb4-6d96a8bacf03 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:45.150898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 226/459] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:45.152320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ef87-95a3-4026-8b1c-31768bec5bcf None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.152612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ef87-95a3-4026-8b1c-31768bec5bcf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.152891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ef87-95a3-4026-8b1c-31768bec5bcf None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.154218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 227/460] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:45.161848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:45.163125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.163550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774fb7-3b5b-45c4-a5aa-b6e98a916be3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.163692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.163841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774fb7-3b5b-45c4-a5aa-b6e98a916be3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.164130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c774fb7-3b5b-45c4-a5aa-b6e98a916be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.164394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.175996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:45.177651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:45.180828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:45.194086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9c774fb7-3b5b-45c4-a5aa-b6e98a916be3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:45.195642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9c774fb7-3b5b-45c4-a5aa-b6e98a916be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:45.197215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:45.198262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:45.199363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:45.199363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:45.199363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:45.199363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:45.199363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 234/461] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:45.199701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.278968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 228/462] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 15:11:45.280164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774fb7-3b5b-45c4-a5aa-b6e98a916be3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.308310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085681e-8e71-47de-af44-35fd8aa5f138 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:45.347426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:45.348599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.349028 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.349459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.362904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:45.364142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:45.365834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:45.384344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:45.385371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:45.386620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:45.386620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:45.386620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:45.386620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:45.388151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 235/463] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:45.389162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.416127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c774fb7-3b5b-45c4-a5aa-b6e98a916be3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:45.443844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:45.453549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:45.457696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.457696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.457696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.457696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:45.457696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:45.457696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:45.470776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 229/464] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:45.470776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.504304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374afab-8f56-4384-985a-82ea9eb27472 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:45.545601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d83e42-eb72-4ed2-b333-0492a56ed15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:45.546399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83e42-eb72-4ed2-b333-0492a56ed15b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.546719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83e42-eb72-4ed2-b333-0492a56ed15b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.547007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d83e42-eb72-4ed2-b333-0492a56ed15b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.558106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d83e42-eb72-4ed2-b333-0492a56ed15b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:45.559582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d83e42-eb72-4ed2-b333-0492a56ed15b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-39d83e42-eb72-4ed2-b333-0492a56ed15b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:45.577990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:45.578862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:45.579710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:45.579710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:45.579710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:45.579710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:45.581536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 236/465] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:45.582991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5be7a-f677-4cb1-bdc2-7e6fd9153393 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.583279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5be7a-f677-4cb1-bdc2-7e6fd9153393 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.583558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5be7a-f677-4cb1-bdc2-7e6fd9153393 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.584960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 237/466] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:45.587667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5be7a-f677-4cb1-bdc2-7e6fd9153393 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.588932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c34034-a87b-4453-8d87-290aada2917c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:45.606800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:45.626787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:45.627486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.627771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.628056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.628784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:45.629098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:45.630709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:45.644090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 230/467] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:45.649055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.694901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:45.699486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5be7a-f677-4cb1-bdc2-7e6fd9153393 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:45.735272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:45.736173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.736665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.737106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.737970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:45.739570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:45.757842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621f7e5-c6f4-4d18-914f-33555a4e1597 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:45.794110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81cdf7-68bb-4f80-84e3-485bac39700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:45.794807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81cdf7-68bb-4f80-84e3-485bac39700d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.795092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81cdf7-68bb-4f80-84e3-485bac39700d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.795366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81cdf7-68bb-4f80-84e3-485bac39700d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.796086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81cdf7-68bb-4f80-84e3-485bac39700d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:45.796464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81cdf7-68bb-4f80-84e3-485bac39700d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:45.797846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81cdf7-68bb-4f80-84e3-485bac39700d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:45.809081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 231/468] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:45.810280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691aa26-445e-41ea-8174-01433afa5b31 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:45.810570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691aa26-445e-41ea-8174-01433afa5b31 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:45.810878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691aa26-445e-41ea-8174-01433afa5b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:45.827260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a691aa26-445e-41ea-8174-01433afa5b31 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:45.828432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a691aa26-445e-41ea-8174-01433afa5b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:45.855091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 238/469] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:45 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:45.856044 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.866044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:45.916521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 232/470] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:45.917417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691aa26-445e-41ea-8174-01433afa5b31 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:45.987779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703020b6-8b38-49f3-b3dd-0e3008037396 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:46.027635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:46.028682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.029244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.029744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.030743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:46.032460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:46.033686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691aa26-445e-41ea-8174-01433afa5b31 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:46.071616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f92986-ee08-441f-ad96-79a03279abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:46.072325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92986-ee08-441f-ad96-79a03279abce None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.072618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92986-ee08-441f-ad96-79a03279abce None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.072889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f92986-ee08-441f-ad96-79a03279abce None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.073618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f92986-ee08-441f-ad96-79a03279abce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:46.075119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f92986-ee08-441f-ad96-79a03279abce None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:46.119542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 239/471] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:45 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:46.120182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:46.143916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 233/472] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:45 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:46.146793 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:46.279757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab400bd-7495-4fcd-b8cc-b0b08260e926 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:46.283128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333eacb2-15aa-4ca3-933d-0a532cf5286f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.283444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333eacb2-15aa-4ca3-933d-0a532cf5286f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.283765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333eacb2-15aa-4ca3-933d-0a532cf5286f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.285517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 234/473] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:11:46.291515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5495e-e419-4253-960d-acd73126267d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.292146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5495e-e419-4253-960d-acd73126267d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.292643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5495e-e419-4253-960d-acd73126267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.324432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d4a5495e-e419-4253-960d-acd73126267d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:46.326033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d4a5495e-e419-4253-960d-acd73126267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:46.334873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:46.335755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.336041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.336317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.351840 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:46.353661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:46.355476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:46.381134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:46.386759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:46.387999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:46.387999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:46.387999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:46.387999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:46.387999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 240/474] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:46.388519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:46.435281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 235/475] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:46.462703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5495e-e419-4253-960d-acd73126267d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:46.474519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:46.527960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856de683-eff3-4cd2-a110-bc9ddf4cf3fd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:46.573581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:46.574490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.574977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.575405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.576283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:46.576827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:46.578422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:46.592010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 241/476] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:46.603862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:46.609873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5495e-e419-4253-960d-acd73126267d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:46.648889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:46.649579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.649870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.650153 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.650935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:46.652473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:46.694796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.sql.core [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 15:11:46.694796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 15:11:46.694796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [parameters: {'id': '52598aada0b74fa7adf731430f4c327f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 15:11:46.694796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 20 15:11:46.727529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:11:46.728478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application yield resource Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise self.value Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application session.commit() Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 15:11:46.729370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.flush() Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application compat.raise_( Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 15:11:46.738276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:11:46.739355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:11:46.740186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [parameters: {'id': '52598aada0b74fa7adf731430f4c327f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:46.740983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 15:11:46.741867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:46.744341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 236/477] 10.222.0.87 () {60 vars in 1131 bytes} [Wed Jul 20 15:11:46 2022] POST /identity/v3/roles => generated 144 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:46.744341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:46.744613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec6429-b5e4-4cc8-b92b-5e4f8f2e6a80 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:46.772515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:46.780724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:46.798036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec379b2-137c-4474-9281-3b69e4d03e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:46.798744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec379b2-137c-4474-9281-3b69e4d03e43 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.799035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec379b2-137c-4474-9281-3b69e4d03e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.799349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec379b2-137c-4474-9281-3b69e4d03e43 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.800265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec379b2-137c-4474-9281-3b69e4d03e43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:46.801721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec379b2-137c-4474-9281-3b69e4d03e43 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:46.881110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73cf6b-a1af-4c5b-bec0-8abe91039a02 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:46.920935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:46.921749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:46.922029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:46.922348 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:46.934070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:46.943216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:46.944112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 15:11:46.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:46.945508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 237/478] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:11:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:46.951020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:47.001815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 242/479] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:46 2022] POST /identity/v3/users => generated 249 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:47.055445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:47.090736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c13c-fbfd-4ecf-a0a0-698a5a71fa34 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:47.131785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9ff05-a0fa-4120-ac90-f3596fc5ab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:47.132373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ff05-a0fa-4120-ac90-f3596fc5ab7d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:47.132653 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ff05-a0fa-4120-ac90-f3596fc5ab7d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:47.132927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9ff05-a0fa-4120-ac90-f3596fc5ab7d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:47.133683 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9ff05-a0fa-4120-ac90-f3596fc5ab7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:47.133989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9ff05-a0fa-4120-ac90-f3596fc5ab7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:47.135770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9ff05-a0fa-4120-ac90-f3596fc5ab7d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:47.146179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 238/480] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:48.467082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ca5c0-15bc-4c9b-be1e-00595cce24d9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:48.468118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ca5c0-15bc-4c9b-be1e-00595cce24d9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:48.468653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ca5c0-15bc-4c9b-be1e-00595cce24d9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:48.470658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 243/481] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:48.477123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f97975-39ef-4b34-a6a3-14692ca30f81 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:48.477974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f97975-39ef-4b34-a6a3-14692ca30f81 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:48.478459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f97975-39ef-4b34-a6a3-14692ca30f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:48.501059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c2f97975-39ef-4b34-a6a3-14692ca30f81 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:48.503294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c2f97975-39ef-4b34-a6a3-14692ca30f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:48.608027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 239/482] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:48.648811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ca5c0-15bc-4c9b-be1e-00595cce24d9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:48.800730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ca5c0-15bc-4c9b-be1e-00595cce24d9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:48.816613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755dc83-0541-4ec0-bd21-7d7f45c3b5e6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:48.816916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755dc83-0541-4ec0-bd21-7d7f45c3b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:48.817181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755dc83-0541-4ec0-bd21-7d7f45c3b5e6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:48.819005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 240/483] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:48.823705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95946ec2-dabf-4025-aed1-ed263d5219cf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:48.823994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95946ec2-dabf-4025-aed1-ed263d5219cf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:48.824272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95946ec2-dabf-4025-aed1-ed263d5219cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:48.845886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce037ac-8887-4190-8ce6-6eb418b32afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:48.847658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce037ac-8887-4190-8ce6-6eb418b32afd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:48.848151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce037ac-8887-4190-8ce6-6eb418b32afd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:48.848545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-95946ec2-dabf-4025-aed1-ed263d5219cf None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:48.849167 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce037ac-8887-4190-8ce6-6eb418b32afd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:48.849749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-95946ec2-dabf-4025-aed1-ed263d5219cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:48.873780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce037ac-8887-4190-8ce6-6eb418b32afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3ce037ac-8887-4190-8ce6-6eb418b32afd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:48.885092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:48.886285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:48.887139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:48.894061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 244/484] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:48.894061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6234cca-20b4-4be4-8b8b-53c59c01563f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:48.894061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6234cca-20b4-4be4-8b8b-53c59c01563f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:48.894061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6234cca-20b4-4be4-8b8b-53c59c01563f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:48.894636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 245/485] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:48.897916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6234cca-20b4-4be4-8b8b-53c59c01563f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:48.954119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:48.957143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:48.962273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 241/486] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:48.963527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7ed7e-8219-48ff-b7cf-244a193642f9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:48.966786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7ed7e-8219-48ff-b7cf-244a193642f9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:48.966786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7ed7e-8219-48ff-b7cf-244a193642f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:48.999725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a5b7ed7e-8219-48ff-b7cf-244a193642f9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:49.000932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a5b7ed7e-8219-48ff-b7cf-244a193642f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:49.027102 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6234cca-20b4-4be4-8b8b-53c59c01563f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.071215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.072258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.072971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.073415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.075010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:49.075495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.077849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.083905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 242/487] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:49.092440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7ed7e-8219-48ff-b7cf-244a193642f9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.092659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 246/488] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:49.093992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.231228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7ed7e-8219-48ff-b7cf-244a193642f9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.231787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b10bb1-ee2a-405c-9ece-09d629d7292d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.234555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:49.264621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:49.272315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.273509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.274004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.274369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.274623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.275361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.275696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.275986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.287364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.289753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:49.290243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:49.299334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:49.300322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:49.301109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:49.305952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 243/489] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:49.307077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:49.316602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:49.317465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:49.318335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:49.318335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:49.318335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:49.318335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:49.325162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 247/490] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:49.326375 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.438331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b8340-0045-447f-98fe-163bd87529d6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.438906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224c9bc-eea0-4bd7-8806-f25c7a23e4f6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.477848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ccd24-8050-45e6-b515-7a5b166824b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.479690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccd24-8050-45e6-b515-7a5b166824b6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.480180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccd24-8050-45e6-b515-7a5b166824b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.480689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.481102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccd24-8050-45e6-b515-7a5b166824b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.481360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.481642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.481918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.482670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:49.482989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.484361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.494228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ccd24-8050-45e6-b515-7a5b166824b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:49.496311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 248/491] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:49.497292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ca5ccd24-8050-45e6-b515-7a5b166824b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:49.503883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:49.504817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:49.505617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 244/492] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:49.510801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0c6d-473b-4b33-9c80-1ac32a7db020 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.510801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0c6d-473b-4b33-9c80-1ac32a7db020 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.510801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0c6d-473b-4b33-9c80-1ac32a7db020 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.522761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 245/493] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:49 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:49.522761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a0c6d-473b-4b33-9c80-1ac32a7db020 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.523465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:49.579244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:49.614932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2c777-5c6e-48fe-810a-6dda937067bc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.633246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a0c6d-473b-4b33-9c80-1ac32a7db020 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.652795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.653466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.653755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.654038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.655119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:49.655632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.657029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.672995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 249/494] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:49.673157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c88a0-05b6-4533-bc61-db2dc2dab797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.673267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.673371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c88a0-05b6-4533-bc61-db2dc2dab797 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.673371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c88a0-05b6-4533-bc61-db2dc2dab797 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.673371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c88a0-05b6-4533-bc61-db2dc2dab797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.684777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c88a0-05b6-4533-bc61-db2dc2dab797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.686414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c88a0-05b6-4533-bc61-db2dc2dab797 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-827c88a0-05b6-4533-bc61-db2dc2dab797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:49.706804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:49.707682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:49.708541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:49.708541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:49.708541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:49.708541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:49.712605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 246/495] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:49.713875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e2b82-8917-4402-b647-7de4bf2031f5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.714167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e2b82-8917-4402-b647-7de4bf2031f5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.714450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e2b82-8917-4402-b647-7de4bf2031f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.730598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e79e2b82-8917-4402-b647-7de4bf2031f5 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:49.731826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e79e2b82-8917-4402-b647-7de4bf2031f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:49.758122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:49.782334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606f78-8edc-473a-b300-73c15e7af673 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.804550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 247/496] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:49.805309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e2b82-8917-4402-b647-7de4bf2031f5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.828374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.829618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.829842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.830124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.830921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:49.831236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.832754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.837468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:49.841497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 250/497] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:49.846294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.915239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e2b82-8917-4402-b647-7de4bf2031f5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.947013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6810d-ced1-4b45-a976-3bb9a01a9f85 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:49.949426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.950222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.950504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.950814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.958052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.959547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:49.974956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:49.975909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 248/498] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:49.976943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:49.983929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:49.984614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:49.984877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:49.985158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:49.985886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:49.986195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:49.988368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:49.995344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.001083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 251/499] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:50.003589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.071943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.083871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e2f7-1ecd-42a0-963a-6af264af0d58 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.101531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb221-7c27-47c0-ad6f-8ffedee811aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.115283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a96bcb-c4aa-44ef-988c-144d16ea95e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.116072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96bcb-c4aa-44ef-988c-144d16ea95e5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.116364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96bcb-c4aa-44ef-988c-144d16ea95e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.116642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96bcb-c4aa-44ef-988c-144d16ea95e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.126670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a96bcb-c4aa-44ef-988c-144d16ea95e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.128174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a96bcb-c4aa-44ef-988c-144d16ea95e5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.136087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.136873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.137157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.137435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b3a96bcb-c4aa-44ef-988c-144d16ea95e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:50.145681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:50.146725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:50.147774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:50.147774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:50.147774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:50.147774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:50.148116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.148930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.150779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 249/500] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:50.152497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e381790-83d5-401d-9de2-41ea9461c7b7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.152794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e381790-83d5-401d-9de2-41ea9461c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.153074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e381790-83d5-401d-9de2-41ea9461c7b7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.154380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 250/501] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:50.155103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e381790-83d5-401d-9de2-41ea9461c7b7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:50.166994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:50.168000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:50.168833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:50.168833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:50.168833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:50.168833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:50.168833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 252/502] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:50.169090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.217745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.260019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e381790-83d5-401d-9de2-41ea9461c7b7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.267993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6907c-3000-4396-8ae9-4091de9b3d3d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.295170 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed281a6-02e6-405c-b621-5b872bd8e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.295835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed281a6-02e6-405c-b621-5b872bd8e582 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.296119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed281a6-02e6-405c-b621-5b872bd8e582 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.296412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed281a6-02e6-405c-b621-5b872bd8e582 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.297241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed281a6-02e6-405c-b621-5b872bd8e582 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:50.297551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed281a6-02e6-405c-b621-5b872bd8e582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.299026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed281a6-02e6-405c-b621-5b872bd8e582 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.302007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.302870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.303156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.303438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.311588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.313024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:50.328287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:50.329379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:11:50.330510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:50.332288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.334244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 253/503] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:50.334942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.336591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 251/504] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:50.337817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464af55-8229-41dd-8646-55b323e35980 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.338112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464af55-8229-41dd-8646-55b323e35980 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.339173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464af55-8229-41dd-8646-55b323e35980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.355356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c464af55-8229-41dd-8646-55b323e35980 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:50.356590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c464af55-8229-41dd-8646-55b323e35980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:50.424829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 252/505] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:50.425641 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464af55-8229-41dd-8646-55b323e35980 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.437722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce192-3155-45bf-871e-5a4b3a2a5c9c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.448479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.472654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.473515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.474044 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.474323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.475082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:50.475394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.476773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.488406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 254/506] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:50.489188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.541122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464af55-8229-41dd-8646-55b323e35980 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.569043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.574463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.575513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.575800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.576072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.576847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:50.577150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.578534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.590219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 253/507] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:50.591023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.597957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e9c79-6b26-4dbe-ac1e-b948c5c90203 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.631198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.631858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.632134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.632406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.633241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:50.633547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.635001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.671615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 255/508] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:50.672422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.688580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6736a27-1c8c-450b-8f7c-28210b4370bb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.700907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.722584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.723261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.723551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.723830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.773034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13336fc7-11b1-490e-ba67-0b9675982408 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.779881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.790232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.791738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.808486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.809475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.809755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.810029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.820505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:50.828172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:50.829177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:50.829974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 256/509] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:50.831945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.892710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 254/510] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:50.894468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:50.927758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.942608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701111-703a-4850-ad7d-25c37a43cae6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:50.976511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:50.977180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:50.977466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:50.977748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:50.978452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:50.979960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:50.983972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:50.993432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cad83-f60e-4389-8fe2-b474d6679781 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.027378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.028161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.028453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.028732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.035553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.036997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:51.051085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:51.052132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 255/511] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:51.053090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.095262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 257/512] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:11:50 2022] POST /identity/v3/users => generated 247 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:11:51.096078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.173708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb6f4a-e5b6-4f2d-bddd-ada57ee39b06 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.210563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbc1cd-c6be-46b0-8899-f60ddf55e13e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.213816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.214476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.214790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.215066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.239490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:51.249150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.249821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.250102 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.250436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.251225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:51.251535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.256077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.265834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 258/513] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:51.266704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.279109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:51.296101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.297573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.384945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7c570-957a-4a1e-9e41-b66a41619631 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.408871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 256/514] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:51.408871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.425819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.426554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.426899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.427183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.438249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.439812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:51.457648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:51.458582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:51.459474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:51.459474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:51.459474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:51.459474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:51.459474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 259/515] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:51.459732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.466488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:51.521284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57907-0242-4272-86c7-e1a2eac613d9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.535792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:51.557917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.558603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.558926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.559203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.560088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:51.560398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.561844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.584870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 257/516] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:51.585083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cfd65-07ab-43cb-82c2-a2982539de40 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.585181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.620512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.621310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.621595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.621874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.634056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.636051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:51.653350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:51.654412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:51.655327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:51.655327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:51.655327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:51.655327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:51.655327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 260/517] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:51.655754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.696377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ed377-5871-48d5-9d6d-178624580b56 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.706611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:51.731842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.732638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.732918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.733195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.744340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.745824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:51.764609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:51.765505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:51.766367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:51.766367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:51.766367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:51.766367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:51.766631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981757f-9caf-47ec-a362-6cc2b7ca6b44 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.770416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 258/518] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:51.771299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.777141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:51.802918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.803680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.804018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.804260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.805058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:51.805372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.806778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.823452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 261/519] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:51.823452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:51.887647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bb0af-a9e4-450e-ad82-5808130fad81 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.922995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.923693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.923974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.924898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.932392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aadc32-bef4-49c4-be66-d909e0e53a65 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:51.953186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:51.967099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:51.967765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:51.968053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:51.968334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:51.969062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:51.969372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:51.970779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:51.982989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 262/520] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:51.983776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.001753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.003422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.018530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.094511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5653d9-4395-4718-88dc-e6397090aecb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.116549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 259/521] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:52.117657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.138102 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.139205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.139854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.140150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.140879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:52.141187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.143640 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.161794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 263/522] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:52.161794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.191833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.237562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c22a8-7806-4a9f-adbf-2403055ad6b4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.259545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.272149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffd6a-9ccf-4986-a622-257f898ba261 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.277492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.278307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.278586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.278902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.286984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.288458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:11:52.303405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:52.304299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:52.305155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 260/523] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:52.306232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.315439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.316436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.316720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.316997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.324323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.325748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:52.341265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:52.342190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 264/524] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:52.343228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.419546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0cf13-4a3c-4882-be00-37287f4189bd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.443175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.450150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0126b26-0555-4fb1-9749-255b08ba7c44 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.459281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.460078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.461839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.461839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.470497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.472788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.487324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.488401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.488829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.489247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:52.491468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:52.492317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:52.493261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:52.493261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:52.493261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:52.493261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:52.493261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 261/525] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:52.493828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.498792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.500765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:11:52.519778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:52.520701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:52.521861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 265/526] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:52.522461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.534848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.611251 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50c17-bfe8-43a8-a901-394384064ede None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.629934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e2012-57ca-4c18-add5-065f954bb54f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.648592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.649241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.649520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.649797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.650620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:52.650959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.652391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.666297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.666995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.667281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.667555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.668392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:52.668703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.670133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.671496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 262/527] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:52.672113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.693235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 266/528] 10.222.0.87 () {56 vars in 1139 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:52.694457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.708995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.765284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.785594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286328b9-60dc-49cd-a4bd-59a5cfe8decc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.801191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab842cc6-a608-4cf0-9db7-5227e753f513 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.822835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.823845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.824332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.824793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.825754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:52.826305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.827945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.837272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.837934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.838220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.838499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.839329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:52.839666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.841060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:52.843709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 263/529] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:52.844828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.863855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 267/530] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:52.865091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:52.946952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:52.956284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7a14-f21b-4c29-9f66-3b253ed10a07 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.977588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64c69-fdc0-421d-965a-b05122a6c904 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:52.993240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:52.993898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:52.994183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:52.994459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:52.995329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c7816f91ee6e489dbe9642b5bd25a454) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:52.995642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:52.997080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.002882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 264/531] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/role_assignments?user.id=c7816f91ee6e489dbe9642b5bd25a454&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:53.004349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:53.011887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.013822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.014605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.014977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.019583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.100850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.102353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.177914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45cebe-005d-4ce5-8a67-7511f08486d0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.220463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeb743-64b9-4e6a-bc38-7af83703fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.221463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeb743-64b9-4e6a-bc38-7af83703fc5d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.221745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeb743-64b9-4e6a-bc38-7af83703fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.222123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeb743-64b9-4e6a-bc38-7af83703fc5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.224595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 268/532] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:53.225816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.230940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeb743-64b9-4e6a-bc38-7af83703fc5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.232412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeb743-64b9-4e6a-bc38-7af83703fc5d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-aafeb743-64b9-4e6a-bc38-7af83703fc5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:11:53.248143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:53.249018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:53.249864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 265/533] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:53.250932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263655fb-76f2-43de-b24c-03ce1c3130d4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.250932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263655fb-76f2-43de-b24c-03ce1c3130d4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.251234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263655fb-76f2-43de-b24c-03ce1c3130d4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.259149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 266/534] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:53.259149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263655fb-76f2-43de-b24c-03ce1c3130d4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.263784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:53.275920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:53.339929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb0715-5b0f-4fde-9747-fdbb1e7409ca None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.362590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263655fb-76f2-43de-b24c-03ce1c3130d4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.376780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.377701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.378173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.378456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.379333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=1e49a95b86044f5aa9ff4a084ee8cee5) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:53.379674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.381105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.394691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 269/535] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/role_assignments?user.id=1e49a95b86044f5aa9ff4a084ee8cee5&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:53.394691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.409303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2200353-7dc5-48f3-acc3-1e4b81b3a4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.410241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200353-7dc5-48f3-acc3-1e4b81b3a4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.410525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200353-7dc5-48f3-acc3-1e4b81b3a4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.410862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2200353-7dc5-48f3-acc3-1e4b81b3a4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.422800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2200353-7dc5-48f3-acc3-1e4b81b3a4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.424894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2200353-7dc5-48f3-acc3-1e4b81b3a4d0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b2200353-7dc5-48f3-acc3-1e4b81b3a4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:53.445179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:53.446093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:53.447073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:53.447073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:53.447073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:53.447073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:53.447073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 267/536] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:53.449497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f75264-eb75-4f02-990f-74a45467db88 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.449497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f75264-eb75-4f02-990f-74a45467db88 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.449497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f75264-eb75-4f02-990f-74a45467db88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.472780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-51f75264-eb75-4f02-990f-74a45467db88 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:53.474012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-51f75264-eb75-4f02-990f-74a45467db88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:53.528487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77f263-e2da-49e8-be06-013cd6cf519e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.558869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:53.559056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 268/537] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:53.559720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f75264-eb75-4f02-990f-74a45467db88 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.564039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:53.567103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.567764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.568045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.568320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.569115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:53.569421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.570951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.590371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 270/538] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:53.591330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.690866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f75264-eb75-4f02-990f-74a45467db88 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.712035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ef09e-f7ab-4ef6-9f55-9393a3873930 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.741332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.742269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.742553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.743106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.744246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:53.744816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.746192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.748611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.749435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.749720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.750000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.760312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 269/539] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:53.761414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.767265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:53.775850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:53.776764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 271/540] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:53.778121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.805983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:53.851059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:53.899265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7eb9-b9cb-45c5-a175-6a74d867b286 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.899958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2a88-43ff-4aaa-802f-d5f0222972ab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:53.937148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.938349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.938868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.939353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.943639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:53.944289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:53.944570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:53.944901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:53.945736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=5d166e2866794925bd5bde02040239dd) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:53.946046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.947526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.949085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:53.950996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:53.963032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 270/541] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/role_assignments?user.id=5d166e2866794925bd5bde02040239dd&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:53.963912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:11:53.968808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:53.969707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:53.970583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:53.973795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 272/542] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:53.985742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:54.148087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f4fac-d312-468b-9acb-4d8568c28984 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:54.173392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:54.183006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:54.194591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:54.195470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:54.195902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:54.196252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:54.197120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:54.197495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:54.198181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f60f-26d3-4ea7-9f19-499cb7b68cd5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:54.199806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:54.217219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 271/543] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:54.223573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:54.250755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:54.251440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:54.251729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:54.252013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:54.252872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:54.253187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:54.255511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:54.278196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 273/544] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:54.283232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:54.401551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1aef6-e5f0-4e14-9aba-8ccaa189f550 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:54.459981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88946f4-424f-40b7-ab8f-5320d4f58340 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:54.465078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:54.465881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:54.466160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:54.466432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:54.486898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:54.488390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:54.521959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:54.522852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:54.523698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:54.523698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:54.523698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:54.523698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:54.524453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:54.525120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:54.525410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:54.525692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:54.526538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=a1c06e34aaac441e8b1a6366cc384524) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:54.526883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:54.528331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:54.534873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 274/545] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:54 2022] GET /identity/v3/role_assignments?user.id=a1c06e34aaac441e8b1a6366cc384524&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:54.535277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:54.535830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 272/546] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:54.545299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:54.714885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7db9a1-94bc-40d5-ae49-16b11e661431 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:54.788779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:54.789821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:54.790329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:54.790857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:54.791796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:54.792306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:54.793934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:54.812098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 275/547] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:54.823762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:54.903698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:54.995832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c82b6-43b4-4c4d-9eba-328b13a0284f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:55.034862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66458b5-352e-4a9e-8560-0f142ca7619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:55.035666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66458b5-352e-4a9e-8560-0f142ca7619e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:55.035949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66458b5-352e-4a9e-8560-0f142ca7619e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:55.036230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66458b5-352e-4a9e-8560-0f142ca7619e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:55.048351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66458b5-352e-4a9e-8560-0f142ca7619e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:55.050605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66458b5-352e-4a9e-8560-0f142ca7619e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a66458b5-352e-4a9e-8560-0f142ca7619e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:55.068599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:55.069693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:55.071181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 273/548] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:11:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:55.075430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:55.165869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:55.211648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f898-ba35-4e6c-832a-da60c5607814 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:55.211982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f898-ba35-4e6c-832a-da60c5607814 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:55.212208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f898-ba35-4e6c-832a-da60c5607814 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:55.213703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 274/549] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:55.218550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9af6a-6a80-40b3-849a-04d0318075cd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:55.218862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9af6a-6a80-40b3-849a-04d0318075cd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:55.219144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9af6a-6a80-40b3-849a-04d0318075cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:55.226832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cafa69-c2e3-4dad-bdad-178000893a40 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:55.236041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8ad9af6a-6a80-40b3-849a-04d0318075cd None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:55.237791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8ad9af6a-6a80-40b3-849a-04d0318075cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:55.292682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:55.293293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:55.293577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:55.293851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:55.294793 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:55.295114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:55.296550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:55.337116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 276/550] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Jul 20 15:11:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:55.343384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:55.349542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 275/551] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:11:55.376916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9af6a-6a80-40b3-849a-04d0318075cd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:55.439034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:55.460632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0df0-29a2-4fea-9f38-29948089e92a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:55.475906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:55.500583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:55.501534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:55.502023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:55.503024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:55.561905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9af6a-6a80-40b3-849a-04d0318075cd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:55.579291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:55.581593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:55.659371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:55.660357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:55.660946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:55.661066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:55.683480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 277/552] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:11:55.689151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:55.707276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:55.715411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:55.716318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:55.717135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 276/553] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:11:55.719432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:55.728357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:55.800310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f92777-ce09-43af-a640-67c38bca30db None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:55.837374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:55.838567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:55.839085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:55.839563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:55.851378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:55.853122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:55.872680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:55.873612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:55.874490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:55.874490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:55.874490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:55.874490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:55.876820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 278/554] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:55.882500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:55.950963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:55.999848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:56.004675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b913945-599d-4501-a702-ea5f99bfeba3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.021517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bc1e0-146f-483c-aa3d-10ec2f46aa59 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.041247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4a8e-2878-41fe-b569-42643efd9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.041945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4a8e-2878-41fe-b569-42643efd9a8c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.042249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4a8e-2878-41fe-b569-42643efd9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.042509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4a8e-2878-41fe-b569-42643efd9a8c None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.043293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c4a8e-2878-41fe-b569-42643efd9a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:56.043603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c4a8e-2878-41fe-b569-42643efd9a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.044984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c4a8e-2878-41fe-b569-42643efd9a8c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.057812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 279/555] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:56.062224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9fbdf-a9c9-42e8-b752-aaf1c082b1f2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.062224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9fbdf-a9c9-42e8-b752-aaf1c082b1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.062224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9fbdf-a9c9-42e8-b752-aaf1c082b1f2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.065521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 280/556] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:56.066304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9fbdf-a9c9-42e8-b752-aaf1c082b1f2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.073126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c842774-3009-43c4-a2d7-4ab389c393fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.074022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c842774-3009-43c4-a2d7-4ab389c393fe None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.074503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c842774-3009-43c4-a2d7-4ab389c393fe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.074991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c842774-3009-43c4-a2d7-4ab389c393fe None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.075942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c842774-3009-43c4-a2d7-4ab389c393fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:56.076950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c842774-3009-43c4-a2d7-4ab389c393fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.079027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c842774-3009-43c4-a2d7-4ab389c393fe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.092628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 277/557] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:56.094461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa36df-cdb5-417e-85df-4b4a9df88571 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.094954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa36df-cdb5-417e-85df-4b4a9df88571 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.095435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa36df-cdb5-417e-85df-4b4a9df88571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.117689 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d6fa36df-cdb5-417e-85df-4b4a9df88571 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:56.119623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d6fa36df-cdb5-417e-85df-4b4a9df88571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:56.190249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9fbdf-a9c9-42e8-b752-aaf1c082b1f2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.199680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 278/558] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:56.200589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa36df-cdb5-417e-85df-4b4a9df88571 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.220616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:56.231358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.232560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.233036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.233513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.242299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.244134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:11:56.261210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:56.262612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:56.263570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:56.266055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 281/559] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:56.271991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.286030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:56.313991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa36df-cdb5-417e-85df-4b4a9df88571 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.360792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.361640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.362959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.363332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.377730 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.380109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.403372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcd649-d3f4-4ad4-98a3-98eada33236d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:56.405195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:56.406269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:56.407422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:56.407422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:56.407422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:56.407422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:56.407422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 279/560] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:56.407695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.453989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.454855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.455141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.455934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.470399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:56.482594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:56.483562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:56.484401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 282/561] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:56.485083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.539795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65d5c6-839f-4302-98a5-7bec1333a697 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.544557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:56.571773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:56.578972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.579581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.579969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.580462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.581143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:56.581665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.582901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.599007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 280/562] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:56.599007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.606160 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57ee2-0725-4077-adc3-d1cab0bce032 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.644188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bc2ee-cc06-435f-b792-e253e481925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.644907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bc2ee-cc06-435f-b792-e253e481925e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.645253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bc2ee-cc06-435f-b792-e253e481925e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.645547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bc2ee-cc06-435f-b792-e253e481925e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.646353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bc2ee-cc06-435f-b792-e253e481925e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:56.646694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bc2ee-cc06-435f-b792-e253e481925e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.648099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bc2ee-cc06-435f-b792-e253e481925e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.660410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 283/563] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:56.661689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7021-eec2-44f7-bd68-ee43ecf25a6b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.661981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7021-eec2-44f7-bd68-ee43ecf25a6b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.662263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7021-eec2-44f7-bd68-ee43ecf25a6b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.667444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 284/564] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:56.668196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7021-eec2-44f7-bd68-ee43ecf25a6b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.712280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853095-140d-4fc7-b8ca-44029e2cbd5f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.749162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.749840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.750121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.750401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.751179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:56.751690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.752918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.765901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 281/565] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:56.765901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.780609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7021-eec2-44f7-bd68-ee43ecf25a6b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.790568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:56.817405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c3f32-a8dd-4ff2-b8c0-858af08d15b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.818063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c3f32-a8dd-4ff2-b8c0-858af08d15b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.818349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c3f32-a8dd-4ff2-b8c0-858af08d15b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.818629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c3f32-a8dd-4ff2-b8c0-858af08d15b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.819493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c3f32-a8dd-4ff2-b8c0-858af08d15b0 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=ab1ffde1b21246acb7092df7616e2a11) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:56.819808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c3f32-a8dd-4ff2-b8c0-858af08d15b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.820901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:56.821261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c3f32-a8dd-4ff2-b8c0-858af08d15b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.831090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 285/566] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/role_assignments?user.id=ab1ffde1b21246acb7092df7616e2a11&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:56.832794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968b959-e006-40a1-bdd8-05610276787f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.833089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968b959-e006-40a1-bdd8-05610276787f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.833370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968b959-e006-40a1-bdd8-05610276787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.889539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3968b959-e006-40a1-bdd8-05610276787f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:56.890834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3968b959-e006-40a1-bdd8-05610276787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:56.913051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd774f3-c638-49a6-890c-2684637e8000 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:56.950814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54dc9a-0de9-42d1-993b-dbd97d756abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:56.951620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54dc9a-0de9-42d1-993b-dbd97d756abb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.951903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54dc9a-0de9-42d1-993b-dbd97d756abb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.952702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54dc9a-0de9-42d1-993b-dbd97d756abb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.961818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54dc9a-0de9-42d1-993b-dbd97d756abb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:56.963363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54dc9a-0de9-42d1-993b-dbd97d756abb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:56.971151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 286/567] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:56.972275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968b959-e006-40a1-bdd8-05610276787f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1b54dc9a-0de9-42d1-993b-dbd97d756abb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:56.978124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:56.979285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:56.980233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 282/568] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:56.980835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654fb63-016d-4586-a967-f16a218c690a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:56.980835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654fb63-016d-4586-a967-f16a218c690a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:56.981369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654fb63-016d-4586-a967-f16a218c690a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:56.982562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 283/569] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:56.984960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654fb63-016d-4586-a967-f16a218c690a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.085495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.088652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968b959-e006-40a1-bdd8-05610276787f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.092974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654fb63-016d-4586-a967-f16a218c690a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.106397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.126497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.129263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.129263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.129263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.130272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28809422-9710-4c8c-a194-c9dbf5627fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.131073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809422-9710-4c8c-a194-c9dbf5627fdf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.131262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809422-9710-4c8c-a194-c9dbf5627fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.131515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809422-9710-4c8c-a194-c9dbf5627fdf None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.132477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28809422-9710-4c8c-a194-c9dbf5627fdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:57.132665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28809422-9710-4c8c-a194-c9dbf5627fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.134092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28809422-9710-4c8c-a194-c9dbf5627fdf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:57.141443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.143461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:57.157425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 284/570] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:11:57.157425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac876db-bf19-4bdf-a052-d2981e9071bb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.157425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac876db-bf19-4bdf-a052-d2981e9071bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.157425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac876db-bf19-4bdf-a052-d2981e9071bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:57.166723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:57.167803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:57.168892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:57.168892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:57.168892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:57.168892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:57.174150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 287/571] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:57.174150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.174360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5ac876db-bf19-4bdf-a052-d2981e9071bb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:57.174735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5ac876db-bf19-4bdf-a052-d2981e9071bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:57.254681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 285/572] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:57.254681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac876db-bf19-4bdf-a052-d2981e9071bb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.291462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b7837-75cf-452e-bbc3-476de9f0f387 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.328173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.328981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.329266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.329543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.340755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:57.348741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:57.349693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:57.350515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 288/573] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:57.352304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.358215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.365255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac876db-bf19-4bdf-a052-d2981e9071bb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.371031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.400999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.401790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.402069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.402395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.412862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.414352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:57.433231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:57.434308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:57.440701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:57.440701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:57.440701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:57.440701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:57.440701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 286/574] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:57.440701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.467393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86906-8a59-43a4-b958-b36d5f0700c9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.506571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.507365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.507728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.508081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.508892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:57.509276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.511019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:57.524609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 289/575] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:57.525295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.551967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd3714-8b73-4e25-a0c5-c964816557c4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.593968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.594804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.595078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.595353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.607396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:57.609643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:57.617172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:57.623841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 287/576] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:57.624662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.640622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.642704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7171c14-4154-41e7-bfc3-8f81a98be0c4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.678481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.679176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.679460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.679733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.680471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:57.680776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.682135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:57.691308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 290/577] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:57.692082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.740938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c983d-afe1-426a-91ce-129fd89cd415 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.775259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.775918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.776204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.776479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.777196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:57.777497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.778885 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:57.796728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 288/578] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:57.797659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.803306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dca449-3232-43b0-9a3d-ff501177e6aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.840409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.841212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.841498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.841776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.843823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.850751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.853442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:57.866740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:57.867753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 291/579] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:57.868752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:57.921795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:57.955146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5151b-e66c-4657-9c87-ee5d345b74aa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.986224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3db4af-f688-49b6-b7c6-379a1453d907 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:57.990534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:57.991227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:57.991512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:57.991787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:57.992590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:57.992901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:57.994287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.006820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 289/580] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:58.006820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.029003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.029797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.030083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.030365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.041484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.042992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:58.060029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:58.061107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:58.062034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:58.062034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:58.062034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:58.062034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:58.062034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 292/581] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:58.062034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.121100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:58.124949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628608-70a0-4ae5-a908-f97cd51e7095 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.165147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.165931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.166212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.166863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.168534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:58.173392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.175438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.180095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2f9b-ed02-421d-aca5-c1269d541fcd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:11:58.189460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:58.190771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:58.191686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 290/582] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:58.192920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.221492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.222133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.222447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.222767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.223608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:58.223934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.225362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.248024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 293/583] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:58.248024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.302448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c53b32-980f-4964-a0f0-b05c35f97145 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.340599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.341401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.341687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.341963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.352359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.353833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.356550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4177b-724d-44d8-b3a2-12c53c71805d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.359996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:58.372358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:58.373282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:58.374195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:58.374195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:58.374195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:58.374195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:58.374195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 291/584] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:58.374958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.399572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.400397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.400691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.400974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.401707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:58.402018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.403626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.416899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 294/585] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:58.417692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.430420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:58.497019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450e427-052f-40dd-857d-3ad5966adfe9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.531107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d9727-dd2e-4833-9635-b96e8ec9ba03 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.536059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.536817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.537174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.537527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.538396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:58.538741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.540180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.552685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 292/586] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:58.557870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.575367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.576170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.576455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.576733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.587942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.589396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:58.607190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:58.608124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:58.609054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:58.609054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:58.609054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:58.609054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:58.609054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 295/587] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:58.609899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.629952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:58.673568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb5c0-1b85-4b7c-a7e1-a408bac686ce None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.681261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:58.714651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.715819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.716025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.716299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.717018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:58.717323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.717623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d4a9e-7049-4102-ac68-0e0f40d627a8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.718706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.732043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 293/588] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:58.733160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.763804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.765020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.765549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.766021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.775378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.776839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:58.791645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:58.792593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:58.793511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 296/589] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:58.794218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.851701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e615fd-565f-41f1-b028-97afc337bbbd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.877956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:58.889491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.890409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.890723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.891013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c7816f91ee6e489dbe9642b5bd25a454/roles/b95329feed8c4f02a509b901d6e9844b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.900897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cce43-28e1-41db-95b9-18e47f4ad1b4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:58.906010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=c7816f91ee6e489dbe9642b5bd25a454, role_id=b95329feed8c4f02a509b901d6e9844b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.907509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.936082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:58.936747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:58.937035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:58.937315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:58.938045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:58.938365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:58.939969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:58.951386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 297/590] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:58.952163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.975696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 294/591] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:58 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c7816f91ee6e489dbe9642b5bd25a454/roles/b95329feed8c4f02a509b901d6e9844b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:11:58.976521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:58.995891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.079791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd8cfc-0dad-4e60-8314-153bb1111370 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.090749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d28173-a363-4126-9779-dc4a91e645f7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.119202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272012e8-720d-4200-bb62-8144849bcd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.120395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272012e8-720d-4200-bb62-8144849bcd53 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.120685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272012e8-720d-4200-bb62-8144849bcd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.120964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272012e8-720d-4200-bb62-8144849bcd53 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.125226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.131599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272012e8-720d-4200-bb62-8144849bcd53 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.133105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272012e8-720d-4200-bb62-8144849bcd53 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.141295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.141968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.142250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.142523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.143454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:59.143738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.145173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-272012e8-720d-4200-bb62-8144849bcd53 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:11:59.149561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:59.150493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:59.151550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 298/592] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:59.152501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c249-23e9-4ee3-b942-7127e310670a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.152838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c249-23e9-4ee3-b942-7127e310670a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.153494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574c249-23e9-4ee3-b942-7127e310670a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.155593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 299/593] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:11:59.156341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c249-23e9-4ee3-b942-7127e310670a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.166406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 295/594] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Jul 20 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:59.167396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.258676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.274074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574c249-23e9-4ee3-b942-7127e310670a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.289686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d1eec-52f9-46b7-a328-d9e7b363ffc8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.312318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6e68-82c1-4095-b2f7-deaa2bd7679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.313115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6e68-82c1-4095-b2f7-deaa2bd7679d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.313394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6e68-82c1-4095-b2f7-deaa2bd7679d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.313669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6e68-82c1-4095-b2f7-deaa2bd7679d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.321532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6e68-82c1-4095-b2f7-deaa2bd7679d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.323010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6e68-82c1-4095-b2f7-deaa2bd7679d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.327451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.328235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.328586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.328935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.329899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:59.330346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.332017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-709a6e68-82c1-4095-b2f7-deaa2bd7679d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:11:59.337406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:59.338589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:11:59.339774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:59.340580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 300/595] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:59.341770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02772e4-b58b-482b-8b70-543797881734 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.342056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02772e4-b58b-482b-8b70-543797881734 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.342332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02772e4-b58b-482b-8b70-543797881734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.363120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 296/596] 10.222.0.87 () {56 vars in 1139 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:59.363120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.363814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d02772e4-b58b-482b-8b70-543797881734 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:11:59.365035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d02772e4-b58b-482b-8b70-543797881734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:11:59.417432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.435550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 301/597] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:11:59.436367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02772e4-b58b-482b-8b70-543797881734 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.482852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5e24a-a1d2-4f93-82a8-d8c46caba6d6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.519389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.524464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.525373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.525744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.526078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.536783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.538244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.551580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02772e4-b58b-482b-8b70-543797881734 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:59.557002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:59.558063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:59.559457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:59.559457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:59.559457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:59.559457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:59.562631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 297/598] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:59.563410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.594418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.595369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.596435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.596919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.597882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:59.598385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.600021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.612259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 302/599] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:59.613337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.667978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.673019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b063e0-6a30-48a9-81f7-80f9c2f0ab94 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.710456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.711277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.711561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.711838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.723448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.724920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.725624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea996f6-c1a2-4fcb-b643-a6f79852d2d0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:11:59.743578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:59.744513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:59.745425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:11:59.745425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:11:59.745425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:11:59.745425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:11:59.745425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 298/600] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:59.745696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.771289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.772146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.772427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.772730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.783108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:11:59.785708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:11:59.791666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:11:59.792577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:11:59.793514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 303/601] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:11:59.809728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.858310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17ccf4-ce42-4198-a292-234284767efb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.897098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.897758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.898043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.898256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6e4d2-40f8-432f-800d-6ce86e252944 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:11:59.898815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.899064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:11:59.899374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.900749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:11:59.906378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:11:59.912878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 299/602] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:11:59.917932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:11:59.936100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:11:59.937004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:11:59.937288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:11:59.937568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/1e49a95b86044f5aa9ff4a084ee8cee5/roles/b95329feed8c4f02a509b901d6e9844b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:11:59.952941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=1e49a95b86044f5aa9ff4a084ee8cee5, role_id=b95329feed8c4f02a509b901d6e9844b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:11:59.954607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.013174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:00.021457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277511-9da8-46ce-8976-a833bfd5eeac None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.030925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 304/603] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:11:59 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/1e49a95b86044f5aa9ff4a084ee8cee5/roles/b95329feed8c4f02a509b901d6e9844b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:00.031958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.065380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.066550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.066869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.067148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.067964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:00.068275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.069841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.090000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 300/604] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:00.091066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.194127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a8259-06e9-4ffa-a1e0-183ed223f4de None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.218532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64d949-e6fe-47e3-802f-25dcc94dfcf7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.244055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.245003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.245290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.245565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.246971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:00.247291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.249294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.255245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.256036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.256663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.256663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.260518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 305/605] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:00.261594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.268375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.269962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:00.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:00.285973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:00.286870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 301/606] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:00.287357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.288275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:00.316480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:00.372572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2839f1-c50c-4c09-a7b9-601350b523e4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.420286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.421217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.421503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.421788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.427679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03d44b-e1e0-4640-97b1-0ec30ab91f61 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.431693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.433142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:00.453717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:00.454816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:00.456255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:00.463531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 306/607] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:00.463660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.475565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.476383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.477004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.477004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.488379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.489842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:00.518661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:00.519669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:00.520548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:00.520548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:00.520548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:00.520548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:00.524471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 302/608] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:00.525359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.597337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:00.600564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:00.627817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8f7a9-5607-40d7-a950-16b1875ebdaf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.637088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72e84c-46e2-41cf-8cba-88fd2b813c2a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.677637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.678302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.678583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.678879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.679669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:00.679978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.681407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.685286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.686185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.686728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.687222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.688675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:00.689193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.692124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.699028 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 307/609] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:00.700304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.707609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 303/610] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:00.708661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.808063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7253-5a07-403f-a7c7-5ae8aa9c412c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.835454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973d532-5b69-41d8-8d2a-26956408270e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:00.845759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.846603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.846984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.847350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.848149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:00.848842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.850289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.857415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:00.865780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:00.868413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 308/611] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:00.869248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:00.874908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:00.876074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:00.876559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:00.877671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/5d166e2866794925bd5bde02040239dd/roles/b95329feed8c4f02a509b901d6e9844b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:00.893591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=5d166e2866794925bd5bde02040239dd, role_id=b95329feed8c4f02a509b901d6e9844b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:00.895534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:00.973614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d882a-df9d-407a-9406-6d7a6077b49e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:01.011131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 304/612] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:00 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/5d166e2866794925bd5bde02040239dd/roles/b95329feed8c4f02a509b901d6e9844b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:01.012470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:01.012627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814b735-ef4b-4619-9699-53d0a1a0defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:01.014668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814b735-ef4b-4619-9699-53d0a1a0defc None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.014668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814b735-ef4b-4619-9699-53d0a1a0defc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.014668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814b735-ef4b-4619-9699-53d0a1a0defc None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/a1c06e34aaac441e8b1a6366cc384524/roles/b95329feed8c4f02a509b901d6e9844b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.042550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814b735-ef4b-4619-9699-53d0a1a0defc None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=a1c06e34aaac441e8b1a6366cc384524, role_id=b95329feed8c4f02a509b901d6e9844b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:01.044336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814b735-ef4b-4619-9699-53d0a1a0defc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:01.120030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 309/613] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:00 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/a1c06e34aaac441e8b1a6366cc384524/roles/b95329feed8c4f02a509b901d6e9844b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:01.128474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f2b7-9aa1-481f-b2c5-1214646ce2f4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.128812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f2b7-9aa1-481f-b2c5-1214646ce2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.129098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3f2b7-9aa1-481f-b2c5-1214646ce2f4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.130939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 310/614] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:01.136841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92997-f9ec-431d-bb31-c0d958fcbf7a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.137128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92997-f9ec-431d-bb31-c0d958fcbf7a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.141926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c92997-f9ec-431d-bb31-c0d958fcbf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.170509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-62c92997-f9ec-431d-bb31-c0d958fcbf7a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:01.171815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-62c92997-f9ec-431d-bb31-c0d958fcbf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:01.175494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b7b74-6163-458c-aee5-49ae8e9e3bf4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:01.229762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:01.231665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.232591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.232591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.243190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:01.245622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:01.248914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:01.265933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:01.266989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:01.268503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:01.271715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 305/615] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:01.278545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:01.297161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 311/616] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:01.333444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92997-f9ec-431d-bb31-c0d958fcbf7a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:01.351041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:01.431580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e14fd-043d-4e89-ae5a-42952c60c287 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:01.470071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c92997-f9ec-431d-bb31-c0d958fcbf7a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:01.472082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:01.473804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.474303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.474870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.475920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:01.476463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:01.478539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:01.504785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 306/617] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:01.510151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:01.524803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:01.525760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.526596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.527049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.547673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:01.566394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:01.567422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:01.568293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 312/618] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:01.579648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:01.654858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:01.655426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:01.661578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbfde-c170-47a0-95a0-b64444d8c963 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:01.696943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:01.697737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.698015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.698289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.708989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:01.710576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:01.729470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:01.730538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:01.731502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:01.731502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:01.731502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:01.731502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:01.731502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 307/619] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:01.736998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:01.828677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9adf6d-e6f2-4e4d-98dd-5bf726fa265c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:01.846531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716007ae-4015-4f70-8d53-86c688695d2b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:01.896079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:01.896754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.897033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.897304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.898035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:01.898340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:01.899742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:01.930325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 308/620] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:01.931352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:01.932287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:01.932791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:01.933290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:01.934677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:01.936426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:01.938732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:01.940467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:01.956080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:01.960311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 313/621] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:01.966877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:02.102058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:02.105539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d88e3-7b6c-48ea-bd57-466d914f553e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.152109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:02.152911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.153189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.153456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.160074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc755fb2-de7f-47fd-bb76-df5e1ef57a81 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.175907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:02.177355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:02.200964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:02.201956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:02.202876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:02.202876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:02.202876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:02.202876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:02.202876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 314/622] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:02.212280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:02.229212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:02.230006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.230592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.230592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.242672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:02.244118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:02.265158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:02.266141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:02.267089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 309/623] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:02.272679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:02.354739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:02.391366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd954472-af04-4c63-a07f-796ca77ba18c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.392056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b347ff5-574b-493d-a5bd-7aad5a92d2bf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.428168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c8051-0909-4c7d-9977-022e4eaf0e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:02.428969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c8051-0909-4c7d-9977-022e4eaf0e44 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.429354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c8051-0909-4c7d-9977-022e4eaf0e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.429728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c8051-0909-4c7d-9977-022e4eaf0e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.430609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c8051-0909-4c7d-9977-022e4eaf0e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:02.431039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c8051-0909-4c7d-9977-022e4eaf0e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:02.431776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:02.432446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.432731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.432837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c8051-0909-4c7d-9977-022e4eaf0e44 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:02.433008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.433734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:02.434042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:02.435642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:02.446386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 310/624] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:02.447888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacf825-f16d-473c-ac0f-ef399b99c080 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.448178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacf825-f16d-473c-ac0f-ef399b99c080 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.448457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacf825-f16d-473c-ac0f-ef399b99c080 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.449094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 315/625] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:02.449742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 311/626] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:02.454538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:02.455219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a9334-703e-48b0-98d7-b4e68cbabadf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.455705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a9334-703e-48b0-98d7-b4e68cbabadf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.456052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a9334-703e-48b0-98d7-b4e68cbabadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.471360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:02.473928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b24a9334-703e-48b0-98d7-b4e68cbabadf None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:02.475136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b24a9334-703e-48b0-98d7-b4e68cbabadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:02.547675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 312/627] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:12:02.548522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a9334-703e-48b0-98d7-b4e68cbabadf None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:02.602957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff85b6-62ca-4d0c-9f79-02d11d784e1f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.610406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:02.641067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:02.641972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.642253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.642530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/ab1ffde1b21246acb7092df7616e2a11/roles/b95329feed8c4f02a509b901d6e9844b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.654935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a9334-703e-48b0-98d7-b4e68cbabadf None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.660918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=ab1ffde1b21246acb7092df7616e2a11, role_id=b95329feed8c4f02a509b901d6e9844b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:02.662374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:02.692059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:02.692845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.693124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.693402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:02.700674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:02.702117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:02.716721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:02.718586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 313/628] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:12:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:02.720606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:02.733658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 316/629] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:02 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/ab1ffde1b21246acb7092df7616e2a11/roles/b95329feed8c4f02a509b901d6e9844b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:02.733658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:02.879317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:02.930938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e224-d992-4ac8-ae90-448a7d720359 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.959049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbee209-6a08-46d5-99d9-36c0c8f0b30b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:02.964780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:02.990457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:02.992123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:02.992567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:02.992917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.008796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:03.009255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:03.009977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.010454 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.011202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.012221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:03.012706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:03.014310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:03.019883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:03.020835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:03.021976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 314/630] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:03.027576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.043242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 317/631] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:12:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:03.048292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.162773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994c94-2a10-43d6-a305-6e8dda724902 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:03.225435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:03.226231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.226523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.226861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.227611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:03.227924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:03.230673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:03.239981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 315/632] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:03.247261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.256937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca00bf-d188-4819-8b10-39d737586ab3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:03.297727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:03.315219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:03.317284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fb311-c098-4464-ab90-9818522f4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:03.317953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fb311-c098-4464-ab90-9818522f4a01 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.318237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fb311-c098-4464-ab90-9818522f4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.318528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fb311-c098-4464-ab90-9818522f4a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.409735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99447d0-6bc2-41ba-8e5e-52d8b5e45202 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:03.438534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fb311-c098-4464-ab90-9818522f4a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:03.441448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fb311-c098-4464-ab90-9818522f4a01 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:03.444022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aef5d-0204-4e0e-87ea-f5a087181fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:03.445396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aef5d-0204-4e0e-87ea-f5a087181fdf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.445396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aef5d-0204-4e0e-87ea-f5a087181fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.445611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aef5d-0204-4e0e-87ea-f5a087181fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.457931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aef5d-0204-4e0e-87ea-f5a087181fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:03.459565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aef5d-0204-4e0e-87ea-f5a087181fdf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-815aef5d-0204-4e0e-87ea-f5a087181fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:03.478233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:03.479204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:03.480508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:03.480508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:03.480508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:03.480508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:03.480508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 316/633] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:03.485577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37899c-d47c-4665-9726-ba561d128be2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.485917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37899c-d47c-4665-9726-ba561d128be2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.486209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37899c-d47c-4665-9726-ba561d128be2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.488031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 317/634] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:03.488789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37899c-d47c-4665-9726-ba561d128be2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.553052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 318/635] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:12:03.554836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce194e-611f-44f4-bcd9-a715981c3909 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.555326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce194e-611f-44f4-bcd9-a715981c3909 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.555802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce194e-611f-44f4-bcd9-a715981c3909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.573592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bfce194e-611f-44f4-bcd9-a715981c3909 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:03.575148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bfce194e-611f-44f4-bcd9-a715981c3909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:03.591129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:03.601143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:03.610417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37899c-d47c-4665-9726-ba561d128be2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:03.648109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ad57c-5eab-40bc-9027-9cb7ee64db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:03.648916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad57c-5eab-40bc-9027-9cb7ee64db39 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.649295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad57c-5eab-40bc-9027-9cb7ee64db39 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.649663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad57c-5eab-40bc-9027-9cb7ee64db39 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.655008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 319/636] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:03.655146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad57c-5eab-40bc-9027-9cb7ee64db39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:03.655146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad57c-5eab-40bc-9027-9cb7ee64db39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:03.660984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce194e-611f-44f4-bcd9-a715981c3909 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.661102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad57c-5eab-40bc-9027-9cb7ee64db39 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:03.665110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 318/637] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:03.666560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1506-79bd-428b-8e60-9bc09b80f4db None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.666978 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1506-79bd-428b-8e60-9bc09b80f4db None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.667349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1506-79bd-428b-8e60-9bc09b80f4db None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.669013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 319/638] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:03.670035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1506-79bd-428b-8e60-9bc09b80f4db None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.774513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce194e-611f-44f4-bcd9-a715981c3909 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:03.779027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1506-79bd-428b-8e60-9bc09b80f4db None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:03.809288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:03.813233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.813233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.813233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.813486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e0fc0-65d9-418b-a22a-68d7011d5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:03.814087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e0fc0-65d9-418b-a22a-68d7011d5883 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.814364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e0fc0-65d9-418b-a22a-68d7011d5883 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.815372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e0fc0-65d9-418b-a22a-68d7011d5883 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.822509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:03.823069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e0fc0-65d9-418b-a22a-68d7011d5883 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:03.823996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:03.824490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e0fc0-65d9-418b-a22a-68d7011d5883 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-516e0fc0-65d9-418b-a22a-68d7011d5883 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:03.838528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:03.839505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 320/639] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebbdf5-a910-4775-a55b-bbe2b0655cbd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:03.845581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebbdf5-a910-4775-a55b-bbe2b0655cbd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:03.846585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebbdf5-a910-4775-a55b-bbe2b0655cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:03.846705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:03.847501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:03.848397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:03.848397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:03.848397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:03.848397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:03.848397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 320/640] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:03.848397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.851320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:03.864416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-64ebbdf5-a910-4775-a55b-bbe2b0655cbd None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:03.865813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-64ebbdf5-a910-4775-a55b-bbe2b0655cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:03.873591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:03.942576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 321/641] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:03.943782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebbdf5-a910-4775-a55b-bbe2b0655cbd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:03.967613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca81f-b5cd-45c1-87e1-088ceb583b0f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.002360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.003192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.003483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.003763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.014049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:04.021737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:04.022772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 321/642] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:04.024364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.068946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebbdf5-a910-4775-a55b-bbe2b0655cbd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.093372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.109359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.110447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.110877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.111159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.112963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:04.113281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.115073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.130074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.139786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 322/643] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Jul 20 15:12:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:04.139786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.140060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1ce29-1f54-4ad5-9c3f-ee494c69ff20 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.176579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.177359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.177642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.178033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.178834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:04.179149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.180575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.196568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 322/644] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:04.197384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.252413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6495e9f-2212-4e71-a353-2e8400104842 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.289660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.290746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.290860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.291061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.302488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:04.303736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d8277-6b20-4fb6-86d8-6b08f37a2a9a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:04.310211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:04.311354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 323/645] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:04.312241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.334511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.347355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.348030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.348318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.348610 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.349938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:04.349938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.351048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.359031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 323/646] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:04.359647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.384179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.429962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f709-9c6f-4791-b9b9-94d9caf821c5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.462560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c752b-3175-4739-aa13-2aad5e7f2f10 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.467048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.467861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.468293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.468751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.499652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.500448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.500737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.501018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.513056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.514556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:04.532340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:04.534225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:04.535453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:04.536457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 324/647] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:04.536536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.558738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.560313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.586014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.620691 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.641566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4514a0-1604-43ea-b8f2-710d798a5276 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.671775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 324/648] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:12:04.671775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.681267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.681941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.682225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.682496 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.683280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:04.683591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.684964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.693488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 325/649] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:04.698693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.779615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a518ba-1782-494d-ad4c-de788965a63c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.817330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.818173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.818385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.818688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.824376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8e41-9907-4df3-9cb1-22a3687ba85d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.829220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.831905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.832987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:04.853903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:04.854951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:04.855850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:04.855850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:04.855850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:04.855850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:04.855850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 325/650] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:04.855850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.866928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:04.867652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:04.867945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:04.868226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:04.869026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:04.869341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:04.870940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:04.871264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:04.889930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 326/651] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:04.890981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:04.964382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa170c47-6599-4f8d-bbf0-aa3dbed6d4d9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:04.999162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf1787-ece5-4016-b5a1-02d707830392 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.011166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.011977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.012263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.012554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.023774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.025237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.037217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.038108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.038459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.038833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:05.043700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:05.044735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:05.050963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:05.050963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:05.050963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:05.050963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:05.050963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 326/652] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:05.050963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.056194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.057651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:05.074749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:05.075858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:05.076986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:05.076986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:05.076986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:05.076986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:05.081131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 327/653] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:05.081988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.101387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.111977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.149613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908bd30-0a0b-4583-a08a-8f279d13bfa2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.181250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee4895-9fd6-4fdd-a560-bb0405ee0013 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.183775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a1e7-d6ad-4be3-bc2c-423e33c45cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.184437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a1e7-d6ad-4be3-bc2c-423e33c45cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.184717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a1e7-d6ad-4be3-bc2c-423e33c45cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.184990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a1e7-d6ad-4be3-bc2c-423e33c45cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.185707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82a1e7-d6ad-4be3-bc2c-423e33c45cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:05.186021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82a1e7-d6ad-4be3-bc2c-423e33c45cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.187428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82a1e7-d6ad-4be3-bc2c-423e33c45cc6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.199183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 327/654] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:05.200415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ec43-e878-4ddc-9984-034145e796c1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.200702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ec43-e878-4ddc-9984-034145e796c1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.200981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ec43-e878-4ddc-9984-034145e796c1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.202202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 328/655] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:05.202915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ec43-e878-4ddc-9984-034145e796c1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.219211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.219869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.220155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.220432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.221866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c7816f91ee6e489dbe9642b5bd25a454) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:05.222178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.223655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.229536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 328/656] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/role_assignments?user.id=c7816f91ee6e489dbe9642b5bd25a454&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:05.230138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.319577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ec43-e878-4ddc-9984-034145e796c1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.332032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.349934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.352064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c627-8265-45cf-a888-8da9c9a59dde None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.360690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.375469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.375469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.375469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.375469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:05.375469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.375469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.377413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 329/657] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:05.378430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.395074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac44f84-2f14-4804-b9fe-b7bd9f047e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.396201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44f84-2f14-4804-b9fe-b7bd9f047e17 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.396585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44f84-2f14-4804-b9fe-b7bd9f047e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.396869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44f84-2f14-4804-b9fe-b7bd9f047e17 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.397604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac44f84-2f14-4804-b9fe-b7bd9f047e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:05.397917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac44f84-2f14-4804-b9fe-b7bd9f047e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.399317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac44f84-2f14-4804-b9fe-b7bd9f047e17 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.412509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 329/658] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:05.413630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c2f9-1fcf-4351-9481-0e14b54ba777 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.413921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c2f9-1fcf-4351-9481-0e14b54ba777 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.414199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c2f9-1fcf-4351-9481-0e14b54ba777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.431656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ff62c2f9-1fcf-4351-9481-0e14b54ba777 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:05.432864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ff62c2f9-1fcf-4351-9481-0e14b54ba777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:05.500090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64081817-6bf1-406e-b563-a51e69e99d4e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.509926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 330/659] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:05.509926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62c2f9-1fcf-4351-9481-0e14b54ba777 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.549144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.550197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.550585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.551003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.558948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.560495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:05.575531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:05.576718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 15:12:05.577934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:05.583803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 330/660] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:05.583803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.589501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.623143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62c2f9-1fcf-4351-9481-0e14b54ba777 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.627418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.660993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.662055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.662339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.662711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.669644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.671142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.684957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ac20a-7169-4f7d-87a3-941bc86d3fd3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:05.686052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:05.686966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:05.687903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 331/661] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:05.688396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.727071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.727872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.728154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.728430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.735830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.737340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:05.753655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:05.754722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 331/662] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:05.756819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.797540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146bac9-2d21-4198-a5dd-56ecb949c898 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.828608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.834950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.835857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.836242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.836617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.847380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:05.855997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:05.857151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:05.858161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:05.859168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 332/663] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:05.860080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.871575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef150c-9028-4014-a13c-29da054ce6a5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:05.873991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:05.909452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:05.910048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:05.910332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:05.910607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:05.911474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:05.911785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:05.913226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:05.931268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 332/664] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:05.932011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:05.980617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125360d4-30c7-4127-af2d-b7906e69150f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.016459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.017315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.017858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.018261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.019192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:06.019615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.021163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.033693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 333/665] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:06.034761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.044043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d108-5ae8-4e18-908a-1bac2bde3a04 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.081840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.082506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.082816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.083097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.083924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:06.084231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.085653 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.090533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.107467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 333/666] 10.222.0.87 () {56 vars in 1139 bytes} [Wed Jul 20 15:12:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:06.107467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.132304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.144701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea973afd-c39e-4b53-9e93-9a14d891d5aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.180178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.181187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.181573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.181953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.182841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:06.183256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.184739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.197948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 334/667] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:06.197948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.219425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e2ec7-02ab-424c-837c-16d00bb41b66 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.256140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.256787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.257073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.257345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.299844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625af9-7373-441b-8b6b-43cdcda9a612 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.313596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.332209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.333667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.334511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.335248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.335575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.335857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.336741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=1e49a95b86044f5aa9ff4a084ee8cee5) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:06.337053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.338475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.354669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 335/668] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/role_assignments?user.id=1e49a95b86044f5aa9ff4a084ee8cee5&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:06.354669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.368271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.472101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 334/669] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:12:06.472926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.499310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccb674-8b81-43ec-bf71-3be2f7165e02 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.553650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.554838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.555249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.555627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.596841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc260a2a-0132-4724-b62d-f8adaa3d86cf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.618441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.621388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.639040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.639962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.640342 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.640712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.655200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.656949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.657979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.660568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:06.682669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:06.683783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:06.684872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:06.684872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:06.684872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:06.684872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:06.686377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 335/670] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:06.687284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.788272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 336/671] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:12:06.789715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.794303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c803eff-4331-4d9e-b61e-8e49dd97632f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.842021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.843347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.844270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.844699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.860916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.863247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.881644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:06.883762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:06.884826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:06.886152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:06.886152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:06.886152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:06.886152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:06.890700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 336/672] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:06.890700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:06.916433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad7f4b-f850-468d-884f-1d0bb837b8bd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:06.929507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:06.960642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:06.961718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:06.962145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:06.962562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:06.964529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:06.965338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:06.967217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:06.985989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 337/673] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:06.987709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.025096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9b899-539d-46ed-9f61-8c7776ec89bc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.063992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.065251 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.065740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.066130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.079697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.082400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:07.104481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:07.105583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:07.106470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:07.106470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:07.106470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:07.106470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:07.108293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 337/674] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:07.109193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.121685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6473ec-1c5e-44ae-904c-5d922cf5ffb6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.160599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.161518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.161984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.162519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.163570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:07.164080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.165634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.173864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:07.185293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 338/675] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:07.189986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.192795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:07.218621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb019d-98d9-446c-a386-10a590a6e3cc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.257918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.259203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.259388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.259769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.267739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.269437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:07.285148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:07.286259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:07.287418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:07.289545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 338/676] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:07.290499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.300025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca5fe-93c0-4700-8c4d-dd24d766c58c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.338208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.339748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.340169 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.340591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.341503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:07.341963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.343725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.357779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 339/677] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:07.359017 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.403069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a723a-f32c-4dc6-b554-00451e5a1399 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.423228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:07.440130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.441202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.441481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.441752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.444882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:07.450064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.451537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:07.466787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:07.474059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:07.475229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:07.475765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bf858-60db-41c4-8839-434ea5a8a52f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.475854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 339/678] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:07.475854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.509069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e91ca-6666-48e4-a19c-5edafd87b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.509873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e91ca-6666-48e4-a19c-5edafd87b05e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.510108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e91ca-6666-48e4-a19c-5edafd87b05e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.510386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e91ca-6666-48e4-a19c-5edafd87b05e None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.511515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e91ca-6666-48e4-a19c-5edafd87b05e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:07.511823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e91ca-6666-48e4-a19c-5edafd87b05e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.513255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e91ca-6666-48e4-a19c-5edafd87b05e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.531922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 340/679] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:07.533321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0dd2-3ed4-4f4d-82d3-70a015eeb693 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.533743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0dd2-3ed4-4f4d-82d3-70a015eeb693 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.534241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0dd2-3ed4-4f4d-82d3-70a015eeb693 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.535646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 341/680] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:07.536486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0dd2-3ed4-4f4d-82d3-70a015eeb693 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.603486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc87652-f1bf-4e3d-b56b-0692088add6f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.641117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0dd2-3ed4-4f4d-82d3-70a015eeb693 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.642295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.643426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.643992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.644275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.651483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.653059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.658532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:07.668409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:07.681633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 340/681] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:07.682544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.684342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49699bc5-955e-489b-b7e6-d4f81a7d573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.685011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699bc5-955e-489b-b7e6-d4f81a7d573f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.685299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699bc5-955e-489b-b7e6-d4f81a7d573f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.685580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699bc5-955e-489b-b7e6-d4f81a7d573f None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.686371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49699bc5-955e-489b-b7e6-d4f81a7d573f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:07.686738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49699bc5-955e-489b-b7e6-d4f81a7d573f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.688257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49699bc5-955e-489b-b7e6-d4f81a7d573f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.705571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 342/682] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:07.706856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4c6f-66a1-405f-b91c-8e49ca585a0b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.707152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4c6f-66a1-405f-b91c-8e49ca585a0b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.707435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf4c6f-66a1-405f-b91c-8e49ca585a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.724673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-52bf4c6f-66a1-405f-b91c-8e49ca585a0b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:07.725865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-52bf4c6f-66a1-405f-b91c-8e49ca585a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:07.733868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:07.781574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d538b-bbfe-4260-a8d7-51f7f0ced0aa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.795761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 343/683] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:07.796572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf4c6f-66a1-405f-b91c-8e49ca585a0b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.831554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.832760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.834007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.834578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.899339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf4c6f-66a1-405f-b91c-8e49ca585a0b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:07.907189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:07.912440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.913897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.936028 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:07.936717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:07.937004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:07.937279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:07.938070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:07.938387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:07.939881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:07.956558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 344/684] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:07.956558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:07.976314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:08.029336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 341/685] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:12:08.030092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.060339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e879e09-b06a-41f3-950e-9065f6f7d048 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.095418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.096726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.097015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.097293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.098132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=5d166e2866794925bd5bde02040239dd) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:08.098445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:08.099923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:08.114899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 345/686] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:07 2022] GET /identity/v3/role_assignments?user.id=5d166e2866794925bd5bde02040239dd&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:08.115901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.148851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75bfde-0fea-4857-bdc6-18ce62c06d9d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.154530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:08.200324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.201713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.202007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.202288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.218067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:08.229155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:08.230240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 342/687] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:08.236283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.250520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0a395-155b-4cd9-acec-99511dba1bfa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.259079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:08.306197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.306900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.307184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.307465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.308307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=a1c06e34aaac441e8b1a6366cc384524) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:08.308621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:08.310060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:08.319554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 346/688] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/role_assignments?user.id=a1c06e34aaac441e8b1a6366cc384524&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:08.320641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.367982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903785bb-134d-45ab-b195-c40aa5febdab None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.420527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.422280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.423354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.423911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.439106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:08.441254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:08.457482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:08.464314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:08.465272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:08.466171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:08.466171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:08.466171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:08.466171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:08.466171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 343/689] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:08.469386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8391e-7334-4c6d-9d64-cf74ea3c3514 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.471776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.516501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.517548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.518879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.519402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.520488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:08.521101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:08.522916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:08.533231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 347/690] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:08.539085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.560672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:08.604777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a238d-2197-4953-af3b-dccf53ae6d19 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.645258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d99738-8b30-4fb8-bf6f-0d5648810d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.645925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99738-8b30-4fb8-bf6f-0d5648810d10 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.646211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99738-8b30-4fb8-bf6f-0d5648810d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.646528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d99738-8b30-4fb8-bf6f-0d5648810d10 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.647246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99738-8b30-4fb8-bf6f-0d5648810d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:08.647555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99738-8b30-4fb8-bf6f-0d5648810d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:08.649041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d99738-8b30-4fb8-bf6f-0d5648810d10 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:08.663166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 344/691] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:08.664495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7cec2-4623-40d2-80b4-6b1119e392f0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.664879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7cec2-4623-40d2-80b4-6b1119e392f0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.665161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7cec2-4623-40d2-80b4-6b1119e392f0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.666762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 345/692] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:08.669311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cc7b2-a88b-4355-a1dd-ece67c25dd05 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.671558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7cec2-4623-40d2-80b4-6b1119e392f0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.715759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae456ed-461e-46b0-ae82-62ea1c051899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.717029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae456ed-461e-46b0-ae82-62ea1c051899 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.718071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae456ed-461e-46b0-ae82-62ea1c051899 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.718563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae456ed-461e-46b0-ae82-62ea1c051899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.734286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae456ed-461e-46b0-ae82-62ea1c051899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:08.737943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae456ed-461e-46b0-ae82-62ea1c051899 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1ae456ed-461e-46b0-ae82-62ea1c051899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:08.761066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:08.762019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:08.763643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:08.763643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:08.763643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:08.763643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:08.763643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 348/693] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:08.763918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0680c-1946-4896-8fbf-9dd1cf157afe None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.764122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0680c-1946-4896-8fbf-9dd1cf157afe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.764363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0680c-1946-4896-8fbf-9dd1cf157afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.781850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a7f0680c-1946-4896-8fbf-9dd1cf157afe None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:08.783705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a7f0680c-1946-4896-8fbf-9dd1cf157afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:08.787312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:08.804459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7cec2-4623-40d2-80b4-6b1119e392f0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:08.844850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:08.857591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:08.858754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:08.859294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:08.859753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:08.866675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 349/694] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:08.866675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0680c-1946-4896-8fbf-9dd1cf157afe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.879778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:08.881515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:08.908718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:08.909682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:08.910566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:08.913084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 346/695] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:08.914065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:08.990748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0680c-1946-4896-8fbf-9dd1cf157afe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.027181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.028071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.028235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.028639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.029492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:09.029854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.031368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.035932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e2e2-ef8c-4b58-b719-dc238fd629f2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.039106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:09.044519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 350/696] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:09.045531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:09.084936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.086056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.086520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.087036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.087876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.089959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:09.109566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:09.110625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:09.112168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:09.119220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 347/697] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Jul 20 15:12:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:09.119220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:09.188841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdb686-119f-47fb-a032-fbc919010ff3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.190758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:09.249975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.250427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a90d-8e99-42c3-80a4-2070245fcab1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.251055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.251515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.252561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.254054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:09.255098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.257255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.280919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 351/698] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:09.282420 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:09.292272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.293330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.293844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.294322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.309596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.311926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:09.331666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:09.332768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:09.333709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:09.337266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 348/699] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:12:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:09.338531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:09.373125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:09.417798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485af02-871f-408d-a236-ef7c08b8db87 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.452301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce45088-249f-4f1e-a3a6-f5bb8f44b800 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.454110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.454938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.455906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.456991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.456991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:09.457495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.459000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.469654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 352/700] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Jul 20 15:12:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:09.469654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:09.473464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:09.496744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.497690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.498217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.498763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.499787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=ab1ffde1b21246acb7092df7616e2a11) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:09.500354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.502527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.509489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 349/701] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:09 2022] GET /identity/v3/role_assignments?user.id=ab1ffde1b21246acb7092df7616e2a11&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:09.510594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:09.582157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c121dc0-fbb7-42a5-90a2-8ba212151b5c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.607025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:09.621247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.621808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.622030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.627685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.627685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:09.627685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.627685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.641313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1f021-6039-42f5-bfaf-182de2f9a62b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.647199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 353/702] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:12:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:09.652480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:09.734820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.735501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.735786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.736058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.737326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:09.737627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.739032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:09.746515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 350/703] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Jul 20 15:12:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:09.794915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7d90c-e056-4040-9bb3-89e52081e2a5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:09.835517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:09.836760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:09.837279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:09.837765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:09.896201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:09.920291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:09.922109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:10.027927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 354/704] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 15:12:10.033675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:10.080716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:10.142539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9045e42-8150-41eb-988c-7890c24cd252 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:10.179810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:10.180615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:10.180894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:10.181167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:10.197733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:10.199210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:10.223957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:10.224934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:10.225914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:10.225914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:10.225914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:10.225914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:10.225914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 351/705] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:10.231110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:10.372709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:10.399992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8116e96-44a9-44cd-8921-f07f0bb63e72 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:10.450136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:10.450843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:10.451137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:10.451413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:10.452145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:10.452453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:10.453824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:10.472926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 355/706] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:10.477986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:10.598416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:10.610962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10f1fc-c70d-4e01-a9b2-b59cf56d80e1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:10.655910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b3dbd-6f72-4632-bac5-708f3b2cc8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:10.656628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b3dbd-6f72-4632-bac5-708f3b2cc8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:10.656908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b3dbd-6f72-4632-bac5-708f3b2cc8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:10.657182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b3dbd-6f72-4632-bac5-708f3b2cc8a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:10.669587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b3dbd-6f72-4632-bac5-708f3b2cc8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:10.671071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b3dbd-6f72-4632-bac5-708f3b2cc8a9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-320b3dbd-6f72-4632-bac5-708f3b2cc8a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:10.684855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:10.685867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:10.686871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 352/707] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:10.691913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:10.724227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba0b3-44db-4058-a78e-bfbf161cf665 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:10.724552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba0b3-44db-4058-a78e-bfbf161cf665 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:10.724774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feba0b3-44db-4058-a78e-bfbf161cf665 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:10.726362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 353/708] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:10.731778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1aa01-ede1-41c4-acd7-3a2a6d21b7cb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:10.732174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1aa01-ede1-41c4-acd7-3a2a6d21b7cb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:10.732562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1aa01-ede1-41c4-acd7-3a2a6d21b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:10.750241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0eb1aa01-ede1-41c4-acd7-3a2a6d21b7cb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:10.753946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0eb1aa01-ede1-41c4-acd7-3a2a6d21b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:10.824880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 354/709] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:12:10.850563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd85ea-a4e0-477a-bbc0-e5fae95523c3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:10.869057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1aa01-ede1-41c4-acd7-3a2a6d21b7cb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:10.918600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88690c-a39f-4a6d-ae25-66d8845b9735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:10.919210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88690c-a39f-4a6d-ae25-66d8845b9735 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:10.919492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88690c-a39f-4a6d-ae25-66d8845b9735 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:10.919770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88690c-a39f-4a6d-ae25-66d8845b9735 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:10.920558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88690c-a39f-4a6d-ae25-66d8845b9735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:10.920867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88690c-a39f-4a6d-ae25-66d8845b9735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:10.922276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88690c-a39f-4a6d-ae25-66d8845b9735 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:10.940814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:10.945239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 356/710] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:10.946931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac123abe-75dd-4b48-91c4-9bd9a9c98e59 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:10.947433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac123abe-75dd-4b48-91c4-9bd9a9c98e59 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:10.947980 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac123abe-75dd-4b48-91c4-9bd9a9c98e59 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:10.949663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 357/711] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:10.954364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac123abe-75dd-4b48-91c4-9bd9a9c98e59 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:10.998210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:11.019582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1aa01-ede1-41c4-acd7-3a2a6d21b7cb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:11.056957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826070-94d9-42a6-b084-25a71f9dea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:11.057893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826070-94d9-42a6-b084-25a71f9dea8e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.058174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826070-94d9-42a6-b084-25a71f9dea8e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.058553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826070-94d9-42a6-b084-25a71f9dea8e None admin] PATH_INFO: `/v3/services/network` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.059246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98826070-94d9-42a6-b084-25a71f9dea8e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:11.060932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98826070-94d9-42a6-b084-25a71f9dea8e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:11.068176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac123abe-75dd-4b48-91c4-9bd9a9c98e59 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-98826070-94d9-42a6-b084-25a71f9dea8e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:11.073856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:11.074883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:11.075724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 355/712] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:10 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:11.077038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515b98-b1fc-46aa-9fc8-0708de7971c3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.077038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515b98-b1fc-46aa-9fc8-0708de7971c3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.077295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7515b98-b1fc-46aa-9fc8-0708de7971c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.096986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c7515b98-b1fc-46aa-9fc8-0708de7971c3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:11.098257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c7515b98-b1fc-46aa-9fc8-0708de7971c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:11.108439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:11.109150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.109443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.109714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.110601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c7816f91ee6e489dbe9642b5bd25a454) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:11.111120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:11.113487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:11.119733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 358/713] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:10 2022] GET /identity/v3/role_assignments?user.id=c7816f91ee6e489dbe9642b5bd25a454&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:11.120524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:11.223026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 356/714] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:11.244842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515b98-b1fc-46aa-9fc8-0708de7971c3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:11.260112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:11.308132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89769028-6dbe-43cb-9b6c-7f2b250bae24 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:11.355625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:11.356339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.356622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.356904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.357638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] RBAC: Adding query filter params (name=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:11.357949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:11.359386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:11.370088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 359/715] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:11.379582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:11.392014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:11.415863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7515b98-b1fc-46aa-9fc8-0708de7971c3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:11.454468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:11.455353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.455701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.455983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.466757 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:11.468390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:11.488185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:11.489560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:11.490466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:11.490466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:11.490466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:11.490466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:11.495085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 357/716] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:11.498318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:11.633687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124171e4-1e61-4bac-a706-b6a30dd1e585 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:11.654169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3284b-67cc-4ecc-b341-a0f56f9f377f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:11.685024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:11.691972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:11.696300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd753c3-2395-4015-9689-348873120f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:11.697424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd753c3-2395-4015-9689-348873120f7e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.697865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd753c3-2395-4015-9689-348873120f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.698565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd753c3-2395-4015-9689-348873120f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.699508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd753c3-2395-4015-9689-348873120f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:11.699972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd753c3-2395-4015-9689-348873120f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:11.701498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd753c3-2395-4015-9689-348873120f7e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:11.708747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ce934-1b41-49e9-a3d4-09b24acb9f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:11.709536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ce934-1b41-49e9-a3d4-09b24acb9f66 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.711367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ce934-1b41-49e9-a3d4-09b24acb9f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.711367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ce934-1b41-49e9-a3d4-09b24acb9f66 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.711367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ce934-1b41-49e9-a3d4-09b24acb9f66 None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:11.711367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ce934-1b41-49e9-a3d4-09b24acb9f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:11.712527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ce934-1b41-49e9-a3d4-09b24acb9f66 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:11.715334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 358/717] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:11.723526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd753c3-2395-4015-9689-348873120f7e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:11.726485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 360/718] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:11.869826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd753c3-2395-4015-9689-348873120f7e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:11.913352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5565ce-0f1c-4365-a23b-5212a6d9241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:11.914422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5565ce-0f1c-4365-a23b-5212a6d9241e None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:11.914960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5565ce-0f1c-4365-a23b-5212a6d9241e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:11.915463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5565ce-0f1c-4365-a23b-5212a6d9241e None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:11.916378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5565ce-0f1c-4365-a23b-5212a6d9241e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:11.918032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5565ce-0f1c-4365-a23b-5212a6d9241e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:12.004908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 359/719] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:12:11 2022] POST /identity/v3/users => generated 254 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:12.365042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71e11c-48cb-492d-9e83-bc9dc7fe3727 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:12.365419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71e11c-48cb-492d-9e83-bc9dc7fe3727 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:12.365603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71e11c-48cb-492d-9e83-bc9dc7fe3727 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:12.367014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 361/720] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:12.372557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb2ce3-768c-4276-a260-50b00163b829 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:12.372851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb2ce3-768c-4276-a260-50b00163b829 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:12.373130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb2ce3-768c-4276-a260-50b00163b829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:12.376639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4acff7-7c8a-43a2-bb5a-8dcaa8c46200 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:12.377553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4acff7-7c8a-43a2-bb5a-8dcaa8c46200 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:12.377894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4acff7-7c8a-43a2-bb5a-8dcaa8c46200 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:12.379467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 362/721] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:12.384631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5681d0-618e-4b58-af06-1007902c2f88 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:12.384920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5681d0-618e-4b58-af06-1007902c2f88 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:12.385201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5681d0-618e-4b58-af06-1007902c2f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:12.405111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8acb2ce3-768c-4276-a260-50b00163b829 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:12.405771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8acb2ce3-768c-4276-a260-50b00163b829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:12.406654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ca5681d0-618e-4b58-af06-1007902c2f88 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:12.408581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ca5681d0-618e-4b58-af06-1007902c2f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:12.463313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:12.502337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 360/722] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:12.515984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 363/723] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:12.535849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb2ce3-768c-4276-a260-50b00163b829 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:12.547770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5681d0-618e-4b58-af06-1007902c2f88 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:12.675528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb2ce3-768c-4276-a260-50b00163b829 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:12.729608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:12.730278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:12.730559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:12.730862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:12.731596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:12.732963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:12.755192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5681d0-618e-4b58-af06-1007902c2f88 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:12.779623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:12.793455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:12.794309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:12.794661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:12.794944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:12.805926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:12.813999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:12.815022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:12.815880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 364/724] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:12.828309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 361/725] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:12 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:12.829117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:12.958575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ae827-562c-42ee-ab7e-b502c7f2d388 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:13.024037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:13.025139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.025637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.026125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.027127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:13.028013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:13.029646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:13.040172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 365/726] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:13.047806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:13.099618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:13.181740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b023-aaf6-4f2d-beb1-2a3c81fac9fe None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:13.218999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:13.220152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.221167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.221676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.234035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:13.235803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:13.259030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:13.259976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:13.261138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:13.261138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:13.261138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:13.261138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:13.263093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 362/727] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:13.268833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:13.322190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:13.400607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14455ad-1850-4263-a39d-89d8cfa27a63 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:13.436907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5b6aa-4d79-4a8a-9384-6653a95e2ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:13.437929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5b6aa-4d79-4a8a-9384-6653a95e2ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.438434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5b6aa-4d79-4a8a-9384-6653a95e2ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.438948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5b6aa-4d79-4a8a-9384-6653a95e2ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.440578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5b6aa-4d79-4a8a-9384-6653a95e2ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:13.441091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5b6aa-4d79-4a8a-9384-6653a95e2ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:13.442704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5b6aa-4d79-4a8a-9384-6653a95e2ac2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:13.456659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 366/728] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:13.463702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:13.467619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf812-450d-4123-9816-023273d7918c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.467910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf812-450d-4123-9816-023273d7918c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.468194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaf812-450d-4123-9816-023273d7918c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.471897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 367/729] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:13.475371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee5b1-cc57-4178-9a33-958ec7b84456 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.475663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee5b1-cc57-4178-9a33-958ec7b84456 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.475950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eee5b1-cc57-4178-9a33-958ec7b84456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.493528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f1eee5b1-cc57-4178-9a33-958ec7b84456 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:13.494777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f1eee5b1-cc57-4178-9a33-958ec7b84456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:13.597046 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 368/730] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 15:12:13.618345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eee5b1-cc57-4178-9a33-958ec7b84456 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:13.623478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:13.655723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1539-1cf5-4a4b-ac5a-5e962bda9cc6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:13.671508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:13.729309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:13.730034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.730322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.730598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.747850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:13.749319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:13.770520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:13.771559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:13.772498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:13.778572 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 363/731] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:13.788356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:13.794309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eee5b1-cc57-4178-9a33-958ec7b84456 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:13.895165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:13.895982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.896258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.896537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.914945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532912-0163-4c9d-872e-7b6204d227c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:13.931242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:13.938941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:13.941040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:13.941927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:13.947121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 369/732] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:13.952880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:13.966195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:13.966910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:13.967198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:13.967477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:13.968326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:13.968639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:13.970093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:14.005470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 364/733] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Jul 20 15:12:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:14.012526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:14.019113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:14.240104 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:14.245984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa367402-bab9-437b-9400-7e818fe1e427 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:14.271008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bee5d-e6b8-41c0-b0f0-669662acb94f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:14.290905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cef85-7f6d-42bf-8363-30a8e267dd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:14.291588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cef85-7f6d-42bf-8363-30a8e267dd51 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.291870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cef85-7f6d-42bf-8363-30a8e267dd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.292141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cef85-7f6d-42bf-8363-30a8e267dd51 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.292893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cef85-7f6d-42bf-8363-30a8e267dd51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:14.293196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cef85-7f6d-42bf-8363-30a8e267dd51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:14.294581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cef85-7f6d-42bf-8363-30a8e267dd51 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:14.305612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 370/734] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:14.306956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00e437-f6bb-408f-8226-2bf61a65558e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.307245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00e437-f6bb-408f-8226-2bf61a65558e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.307518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00e437-f6bb-408f-8226-2bf61a65558e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.308988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 371/735] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:14.310747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00e437-f6bb-408f-8226-2bf61a65558e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:14.329159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:14.330016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.330462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.330867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.404901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:14.406669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:14.417177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00e437-f6bb-408f-8226-2bf61a65558e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:14.450386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:14.453652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45818c5-a268-4b22-a49a-5ed333470379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:14.453827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45818c5-a268-4b22-a49a-5ed333470379 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.454098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45818c5-a268-4b22-a49a-5ed333470379 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.454374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45818c5-a268-4b22-a49a-5ed333470379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.465546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45818c5-a268-4b22-a49a-5ed333470379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:14.467027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45818c5-a268-4b22-a49a-5ed333470379 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c45818c5-a268-4b22-a49a-5ed333470379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:14.485549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:14.487155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:14.489064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:14.489064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:14.489064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:14.489064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:14.489064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 372/736] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:14.489064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62cc45-73e8-46ec-861f-2155c28f1e4c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.489860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62cc45-73e8-46ec-861f-2155c28f1e4c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.489860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62cc45-73e8-46ec-861f-2155c28f1e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.495659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:14.506923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ea62cc45-73e8-46ec-861f-2155c28f1e4c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:14.508116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ea62cc45-73e8-46ec-861f-2155c28f1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:14.520898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 365/737] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 15:12:14.522069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:14.594891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 373/738] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 15:12:14.596455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62cc45-73e8-46ec-861f-2155c28f1e4c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:14.638919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b810f-9b9f-420f-bfd2-e8cddb715e26 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:14.642137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:14.676761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:14.677465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.677758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.678039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.678796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:14.679098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:14.680467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:14.693870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 366/739] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:14.693870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:14.719272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62cc45-73e8-46ec-861f-2155c28f1e4c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:14.756187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4395-5939-4b00-a50e-26ce4d8a2c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:14.757002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4395-5939-4b00-a50e-26ce4d8a2c15 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.757285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4395-5939-4b00-a50e-26ce4d8a2c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.757564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4395-5939-4b00-a50e-26ce4d8a2c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.759685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:14.769295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a4395-5939-4b00-a50e-26ce4d8a2c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:14.772791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a4395-5939-4b00-a50e-26ce4d8a2c15 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7d5a4395-5939-4b00-a50e-26ce4d8a2c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:14.789213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:14.790113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:14.791524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:14.791524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:14.791524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:14.791524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:14.791524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 374/740] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:14.792948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ba6f-d66a-41c5-944b-71d7e1f23283 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.793239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ba6f-d66a-41c5-944b-71d7e1f23283 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.793519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744ba6f-d66a-41c5-944b-71d7e1f23283 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.795328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 375/741] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:14.799879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744ba6f-d66a-41c5-944b-71d7e1f23283 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:14.808927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52750c38-6dc0-4e1e-9c38-6a16e15f52c0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:14.844004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:14.844665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.844948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.845224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.846597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:14.848054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:14.919664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744ba6f-d66a-41c5-944b-71d7e1f23283 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:14.923947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 367/742] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:14 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:14.924755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:14.962192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:14.977196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c32b0-7e92-4937-abb5-3123e177df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:14.978985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c32b0-7e92-4937-abb5-3123e177df63 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:14.982367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c32b0-7e92-4937-abb5-3123e177df63 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:14.982673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c32b0-7e92-4937-abb5-3123e177df63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:14.994948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c32b0-7e92-4937-abb5-3123e177df63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:14.996225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c32b0-7e92-4937-abb5-3123e177df63 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9f6c32b0-7e92-4937-abb5-3123e177df63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:15.012458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:15.013494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:15.014437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 376/743] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:12:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:15.015643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dda7f-10d9-4dfc-b913-bd42cffc778f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.015940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dda7f-10d9-4dfc-b913-bd42cffc778f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.016221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dda7f-10d9-4dfc-b913-bd42cffc778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.039698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-214dda7f-10d9-4dfc-b913-bd42cffc778f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:15.041301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-214dda7f-10d9-4dfc-b913-bd42cffc778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:15.062783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2fcb-6b90-4bcb-8a4c-2cb55d24e0f5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.085461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:15.116333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.117475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.117762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.118810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.119594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:15.119922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.121282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.134238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 368/744] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:15.134942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 377/745] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:15.135131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.140986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dda7f-10d9-4dfc-b913-bd42cffc778f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.226371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:15.242121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b46d-c020-479e-abd3-76499e333add None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.249852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dda7f-10d9-4dfc-b913-bd42cffc778f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.280591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.281269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.281620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.282004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.283105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:15.283423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.284861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.296481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.297303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.297667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.298022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.304055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 369/746] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:15.305004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.306261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.307999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:15.325679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:15.326596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:15.327519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:15.328903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 378/747] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:15.331934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.368863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:15.429779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62009d1-d661-405a-b0b4-463318b68d15 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.451885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfca76-fe93-47bf-a410-e9930855b085 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.468808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.469611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.469896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.470175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.481942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:15.490965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:15.492033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:15.492900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 370/748] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:15.493597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.496680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:15.499662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.500488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.500777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.501058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.514672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.516152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:15.537580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:15.538526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:15.539502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:15.539502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:15.539502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:15.539502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:15.539502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 379/749] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:15.540263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.615397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f496-e010-46ab-b17d-914302e5081a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.630585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:15.646945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ccde-5fb1-4ec9-b9ae-7769409fad79 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.655525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf176ca-4230-4d60-8e1e-c248fb587fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.656194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf176ca-4230-4d60-8e1e-c248fb587fdf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.656487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf176ca-4230-4d60-8e1e-c248fb587fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.656768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf176ca-4230-4d60-8e1e-c248fb587fdf None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.657563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf176ca-4230-4d60-8e1e-c248fb587fdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:15.658021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf176ca-4230-4d60-8e1e-c248fb587fdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.660058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf176ca-4230-4d60-8e1e-c248fb587fdf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.672164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 371/750] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:15.673246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8179cde-4bfc-4fe6-a004-5cbcabab735d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.673566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8179cde-4bfc-4fe6-a004-5cbcabab735d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.674001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8179cde-4bfc-4fe6-a004-5cbcabab735d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.675397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 372/751] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:15.675960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8179cde-4bfc-4fe6-a004-5cbcabab735d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.694123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.695287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.695823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.696332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.697284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:15.697783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.699588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.714530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 380/752] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:15.715615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.739689 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:15.782312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8179cde-4bfc-4fe6-a004-5cbcabab735d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.818000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c997fb3-076d-46e3-9cfa-3db1af5d58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.818693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c997fb3-076d-46e3-9cfa-3db1af5d58f2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.818975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c997fb3-076d-46e3-9cfa-3db1af5d58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.819258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c997fb3-076d-46e3-9cfa-3db1af5d58f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.820057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c997fb3-076d-46e3-9cfa-3db1af5d58f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:15.820367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c997fb3-076d-46e3-9cfa-3db1af5d58f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.821590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e20634-8779-466e-92f9-67e96116bd82 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:15.822056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c997fb3-076d-46e3-9cfa-3db1af5d58f2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.836794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 373/753] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:15.837844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5607-1d3f-478c-af53-6051772513f2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.838127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5607-1d3f-478c-af53-6051772513f2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.838399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5607-1d3f-478c-af53-6051772513f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.856608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9b1b5607-1d3f-478c-af53-6051772513f2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:15.857793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9b1b5607-1d3f-478c-af53-6051772513f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:15.862975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:15.863801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:15.864233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:15.864662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:15.865736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=ab1ffde1b21246acb7092df7616e2a11) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:15.865990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:15.867444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:15.878671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 381/754] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/role_assignments?user.id=ab1ffde1b21246acb7092df7616e2a11&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:15.878671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:15.896105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:15.959708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 374/755] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:15.960821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5607-1d3f-478c-af53-6051772513f2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.000503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d540a-cc84-47ad-b903-cb23f2a736ea None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.035063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:16.041048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.041969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.042348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.042728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.057256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.059397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:16.080077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:16.081073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:16.081986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:16.081986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:16.081986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:16.081986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:16.081986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 382/756] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:16.083055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.097411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5607-1d3f-478c-af53-6051772513f2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.135379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.136610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.137004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.137382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.145288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.147142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.160006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:16.164657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:16.165579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:16.166495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:16.169074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 375/757] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:16.170089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.209280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b04812-279a-47e8-bf84-6a034806944d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.254976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.255793 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.256078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.256361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.257021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.258866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:16.277216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:16.278251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:16.279505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 383/758] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:16.280366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.289020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934f2cc-c274-45e5-8a56-984c261802c1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.304204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:16.327723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.328749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.329346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.330359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.331364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:16.332049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.334920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.349562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 376/759] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:16.350703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.416903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17e5a3-ad2f-4555-ba29-8cb934b9c0bf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.450199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:16.460944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.464486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.464486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.464486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.464486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:16.464486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.465162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce86847-6efb-4f2a-8e72-281ddced3375 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.465272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.480398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 384/760] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:16.481299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.519031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.520594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.520890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.521176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.522188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:16.522505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.524108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.530454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 377/761] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:16.531468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.574830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:16.613569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365be8-3a17-41ac-8923-4e346eac8bce None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.645740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168fcd2-a1ba-4784-a131-c21ee78d1e7b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.651878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.652700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.652984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.653263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.662457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.664065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:16.680328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:16.681309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:16.682284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:16.686182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 385/762] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:16.687176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.689772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.691333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.691843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.692354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c7816f91ee6e489dbe9642b5bd25a454/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.694859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=c7816f91ee6e489dbe9642b5bd25a454, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.696644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.737987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:16.766698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 378/763] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:16 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c7816f91ee6e489dbe9642b5bd25a454/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:16.769473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.799442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c18e-34c2-4af2-917c-f68a22740db8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.865785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.866455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.866753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.866963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.867700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:16.868032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:16.869623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:16.875878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 386/764] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:16.882189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:16.947119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:16.953497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb037d4-b72b-4b9d-8b86-f6b16400464a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:16.995566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:16.996257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:16.996984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:16.997276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:16.998129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:16.998446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:17.000606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:17.022318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 379/765] 10.222.0.87 () {56 vars in 1149 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:17.026775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734eb1f-3fd3-4b08-b508-c073bfb51625 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:17.029083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:17.040768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:17.066329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:17.067290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.067578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.067853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.068717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] RBAC: Adding query filter params (interface=public, service_id=8c22227f44914f80a62a06deae76922c, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:17.069028 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:17.070450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:17.079487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 387/766] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:12:16 2022] GET /identity/v3/endpoints?service_id=8c22227f44914f80a62a06deae76922c&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:17.085916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:17.203521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cd310-031c-4a4e-9870-1d70b7c3304b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:17.241817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf1cf7-d71e-4c03-beb2-530931337208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:17.242541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf1cf7-d71e-4c03-beb2-530931337208 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.242857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf1cf7-d71e-4c03-beb2-530931337208 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.243226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf1cf7-d71e-4c03-beb2-530931337208 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.244062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf1cf7-d71e-4c03-beb2-530931337208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:17.245447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf1cf7-d71e-4c03-beb2-530931337208 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:17.250781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 388/767] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:17 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:17.253009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd3a5-3385-4e69-bf83-68a11b7dec68 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.253528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd3a5-3385-4e69-bf83-68a11b7dec68 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.254015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd3a5-3385-4e69-bf83-68a11b7dec68 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.255833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 389/768] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:17.262833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88600-d955-4900-8cf2-fadcf30d6dcd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.263171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88600-d955-4900-8cf2-fadcf30d6dcd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.263398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88600-d955-4900-8cf2-fadcf30d6dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.281405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-58e88600-d955-4900-8cf2-fadcf30d6dcd None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:17.282623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-58e88600-d955-4900-8cf2-fadcf30d6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:17.335452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac85e70-064b-4902-a5cd-cae895e2f2a4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:17.339527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:17.402134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:17.402823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.403108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.403385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.410825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 390/769] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:17.435472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:17.446501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e88600-d955-4900-8cf2-fadcf30d6dcd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:17.493862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:17.495555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:17.579157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e88600-d955-4900-8cf2-fadcf30d6dcd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:17.647990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:17.651045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.651345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.651627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] PATH_INFO: `/v3/services/network` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.652299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:17.653679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:17.667462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 380/770] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:12:17.668690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:17.687099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:17.688139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:17.688982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 391/771] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:17 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:17.695203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:17.755096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:17.791104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:17.864915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e763ea-47a5-4666-8552-f111474f7b70 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:17.874488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c167adc-697c-4198-9404-9871c3fe87c1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:17.900399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:17.901124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.901412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.901692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.902468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] RBAC: Adding query filter params (name=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:17.902809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:17.904256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:17.909733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 392/772] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:17.915524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:17.954211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:17.955116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:17.955560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:17.955847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:17.978622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:17.980183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:18.009131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:18.010055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:18.011232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:18.011232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:18.011232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:18.011232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:18.011473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 381/773] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:18.016663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.090998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:18.107901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380b8a6-035b-4035-bea6-9442f2c77469 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.172722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb48d1-8405-48a8-8adf-4830d3039233 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.181317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95850e49-e5f4-42bb-b6b2-760fd858bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.182010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850e49-e5f4-42bb-b6b2-760fd858bb78 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.182301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850e49-e5f4-42bb-b6b2-760fd858bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.182582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850e49-e5f4-42bb-b6b2-760fd858bb78 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.183386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95850e49-e5f4-42bb-b6b2-760fd858bb78 None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:18.183698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95850e49-e5f4-42bb-b6b2-760fd858bb78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.184296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:18.186489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95850e49-e5f4-42bb-b6b2-760fd858bb78 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.193393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 393/774] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:18.195054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de93de-ffb3-4045-9169-0743dceb70af None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.195539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de93de-ffb3-4045-9169-0743dceb70af None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.201622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de93de-ffb3-4045-9169-0743dceb70af None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.201622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 394/775] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:18.201622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de93de-ffb3-4045-9169-0743dceb70af None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.213489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157cc29-1eb8-438c-bc00-59d18297dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.214156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157cc29-1eb8-438c-bc00-59d18297dacc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.214432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157cc29-1eb8-438c-bc00-59d18297dacc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.215011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157cc29-1eb8-438c-bc00-59d18297dacc None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.215900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157cc29-1eb8-438c-bc00-59d18297dacc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:18.216207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157cc29-1eb8-438c-bc00-59d18297dacc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.218248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157cc29-1eb8-438c-bc00-59d18297dacc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.239860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 382/776] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:18.239860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58779a2-2379-48f8-82e4-922f8e11fb45 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.239860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58779a2-2379-48f8-82e4-922f8e11fb45 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.239860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58779a2-2379-48f8-82e4-922f8e11fb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.258601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c58779a2-2379-48f8-82e4-922f8e11fb45 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:18.260559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c58779a2-2379-48f8-82e4-922f8e11fb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:18.331132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de93de-ffb3-4045-9169-0743dceb70af None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.342620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 383/777] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:18.343997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58779a2-2379-48f8-82e4-922f8e11fb45 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.370230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.371325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.371757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.372229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.373163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] RBAC: Adding query filter params (interface=public, service_id=312151a7397f4c09afc6fdf25a1600cd, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:18.373622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.375403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.381873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 395/778] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/endpoints?service_id=312151a7397f4c09afc6fdf25a1600cd&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:18.383051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.412093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:18.472193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:18.480431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58779a2-2379-48f8-82e4-922f8e11fb45 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.500598 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dfedc-dfb2-4fb9-b9f2-5cfb877a7374 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.532499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.533565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.533937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.534217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.541287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.542760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.546387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.547271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.547561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.547839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:18.557103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:18.558065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:18.558995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 384/779] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:18.559501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.565161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:18.573277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:18.575620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 396/780] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:18.577749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.672931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:18.693601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1696c2-d47d-4e1a-8159-693490eb4b50 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.699868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43ade-8370-4546-8191-3ebb40923bd4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.731903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.732719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.733120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.733546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.734374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:18.734814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.737406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.746606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.747809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.748260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.748692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.749535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.755661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 397/781] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:18.755661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.758006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.765696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 385/782] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:18.766775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.795808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:18.871044 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e7039-d70c-49cb-8b82-d6e112f04813 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.884320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013fe7-99f3-4f9a-97c2-b877d9144c44 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:18.910409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.911435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.911839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.912262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.913143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:18.913554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.915128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.925288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 398/783] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:18.927360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:18.928041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:18.928330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:18.928614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:18.929573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=941ae32ff5224143a43f92f7251822de) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:18.929902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:18.931047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:18.931444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:18.941264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:18.942832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 386/784] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/role_assignments?user.id=941ae32ff5224143a43f92f7251822de&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:19.058920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad89aa3-058c-4a87-968d-b4128ece2068 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:19.100234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4923-b36d-456f-a360-21965e34307f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:19.101408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4923-b36d-456f-a360-21965e34307f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.101897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4923-b36d-456f-a360-21965e34307f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.102373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4923-b36d-456f-a360-21965e34307f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.114904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4923-b36d-456f-a360-21965e34307f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:19.116696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4923-b36d-456f-a360-21965e34307f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b07d4923-b36d-456f-a360-21965e34307f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:19.135608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:19.136827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:19.137745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:19.137745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:19.137745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:19.137745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:19.137745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 399/785] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:19.142770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:19.165216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97476d-bcc5-4ff7-bd4f-d5786d1b4ce9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.165560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97476d-bcc5-4ff7-bd4f-d5786d1b4ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.165784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97476d-bcc5-4ff7-bd4f-d5786d1b4ce9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.167808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 400/786] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:19.173029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf28ee-0372-44db-a262-93a441b4523b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.173309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf28ee-0372-44db-a262-93a441b4523b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.173654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf28ee-0372-44db-a262-93a441b4523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.193571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-24cf28ee-0372-44db-a262-93a441b4523b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:19.195381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-24cf28ee-0372-44db-a262-93a441b4523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:19.259019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:19.274868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 401/787] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:19.300441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf28ee-0372-44db-a262-93a441b4523b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:19.381572 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:19.398780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bc273-0e1b-4845-a8e9-3ac2ee65e660 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:19.436909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:19.437861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.438295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.438756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.440628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:19.441108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:19.442660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:19.455118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 387/788] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:19.458697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf28ee-0372-44db-a262-93a441b4523b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:19.461044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:19.492241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:19.493054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.493347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.493679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.512818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:19.525393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:19.526370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:19.527284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 402/789] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:19.538019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:19.647120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:19.663540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c58bc-f67b-4d5b-a7e0-202bd5f35ee3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:19.702006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:19.702897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.703168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.703509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.719038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:19.721813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:19.742176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:19.743225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:19.744235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:19.744768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a5e6-ff3c-487f-82f1-311c0cc0bb04 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:19.755094 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 388/790] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:19.761906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:19.775036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:19.811553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5ae6-f73f-40e0-a252-fbb66d4875fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:19.812243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5ae6-f73f-40e0-a252-fbb66d4875fd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.812531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5ae6-f73f-40e0-a252-fbb66d4875fd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.812814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5ae6-f73f-40e0-a252-fbb66d4875fd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.813580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5ae6-f73f-40e0-a252-fbb66d4875fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:19.813894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5ae6-f73f-40e0-a252-fbb66d4875fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:19.817029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5ae6-f73f-40e0-a252-fbb66d4875fd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:19.826937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 403/791] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:19.828975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd74f6-5f9e-4686-b86c-0e8e6d13d13e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.828975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd74f6-5f9e-4686-b86c-0e8e6d13d13e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.829173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd74f6-5f9e-4686-b86c-0e8e6d13d13e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.834694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 404/792] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:19.834694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd74f6-5f9e-4686-b86c-0e8e6d13d13e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:19.923770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a48541-e8ce-4658-87b1-fd4d017a1897 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:19.962556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d598a-9432-404f-8557-fe67076d1429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:19.963661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d598a-9432-404f-8557-fe67076d1429 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.964152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d598a-9432-404f-8557-fe67076d1429 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.964657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d598a-9432-404f-8557-fe67076d1429 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:19.965698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d598a-9432-404f-8557-fe67076d1429 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:19.966214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d598a-9432-404f-8557-fe67076d1429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:19.967957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d598a-9432-404f-8557-fe67076d1429 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:19.972921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd74f6-5f9e-4686-b86c-0e8e6d13d13e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:19.992290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:19.992675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 389/793] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Jul 20 15:12:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:19.994305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71bef0-f225-490d-a1a2-f4ee9a503fea None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:19.995078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71bef0-f225-490d-a1a2-f4ee9a503fea None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:19.995597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71bef0-f225-490d-a1a2-f4ee9a503fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.014528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.014982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ce71bef0-f225-490d-a1a2-f4ee9a503fea None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:20.015364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.015647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.015926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.017112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ce71bef0-f225-490d-a1a2-f4ee9a503fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:20.030631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.032552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:20.052693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:20.053648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:20.054581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:20.054581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:20.054581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:20.054581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:20.056939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 405/794] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:20.058088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.094396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:20.106421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 390/795] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:20.107167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71bef0-f225-490d-a1a2-f4ee9a503fea None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.169486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67a4a-db73-4147-8ec6-c83a33b7eeed None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.207052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.208273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.208769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.209294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.220233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71bef0-f225-490d-a1a2-f4ee9a503fea None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.221015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.222784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:20.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:20.244158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:20.245109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:20.245109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:20.245109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:20.245109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:20.252823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 406/796] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:20.254065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.258972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.259648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.259932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.260210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.261186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:20.261501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.262904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.274897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:20.278161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 391/797] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:20.279317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.344698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:20.371718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90bfe-62f0-4a86-9a7b-ae25117b1cf2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.400756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22f58b-0fea-4573-b7a8-81ccd33ceab4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.409641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.410416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.410862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.411247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.412056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.413572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:20.427862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:20.429045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 15:12:20.429914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:20.430742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 407/798] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:20.431992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.445533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.446599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.447088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.447572 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.448483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:20.449067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.450855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.465235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 392/799] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:20.466465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.537132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:20.559865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b967-c25a-495c-a6c4-21667742acbc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.587565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba841-ef7a-4736-8401-7cc0fd8c6084 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.600708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.601630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.601919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.602201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.603753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:20.614600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.616106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.628320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.629298 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.629802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.630279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:20.630688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:20.631601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:20.632543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:20.634139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:20.634686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.636516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.636922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 408/800] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:20.637767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.643401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 393/801] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:20.644487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.783414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4530d3-c06e-467d-90c0-b9d9bd763899 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.787628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d51456-cf07-46c5-aacc-72ecd576dae8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.829173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.830428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.830787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.831122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.831972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:20.832287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.833784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.836151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:20.838144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:20.838690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:20.839172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:20.848425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:20.851210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:20.852647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 394/802] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:20.853481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.853781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:20.870426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:20.873773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:20.874738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 409/803] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:20.875755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:20.907861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:20.987911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8984c9-b99b-4b6b-b2b2-6e5be118ae52 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:20.999213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c34f-284c-45b9-93af-8c2fadca268d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:21.025819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.026513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.026835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.027119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.045642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.046967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.048013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.049141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.050085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:21.050703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.053288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.065245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 395/804] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:21.065245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.107545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:21.112773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.114254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.180917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:21.185156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b882-c68c-4d16-844d-d8b1e8be2374 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:21.224408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.225336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.225794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.226228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.227209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:21.227668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.229254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.232455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 410/805] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:12:21.233424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.245337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 396/806] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:21.246853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.342227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:21.347303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181e36d-837e-432f-88b6-325a085eae39 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:21.365460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396a1cb-c2bc-40f0-870a-90c169571875 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:21.383867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5690f37-d375-426d-97e3-dc5bcf57b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.384534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690f37-d375-426d-97e3-dc5bcf57b9fb None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.384927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690f37-d375-426d-97e3-dc5bcf57b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.385219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690f37-d375-426d-97e3-dc5bcf57b9fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.386208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690f37-d375-426d-97e3-dc5bcf57b9fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.387608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690f37-d375-426d-97e3-dc5bcf57b9fb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.399431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.400244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.400528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.400805 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.411953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.413398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:21.430833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:21.431914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:21.432810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:21.432810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:21.432810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:21.432810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:21.432810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 397/807] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:21.432810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.448596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:21.490359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 411/808] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:21.491741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1320-12b3-4ca1-b58d-74414b28bc91 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.492035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1320-12b3-4ca1-b58d-74414b28bc91 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.492305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1320-12b3-4ca1-b58d-74414b28bc91 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.493879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 412/809] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:21.494707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1320-12b3-4ca1-b58d-74414b28bc91 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.567736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446c54-5d2a-4b11-8a78-7e96bfdeabfc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:21.612450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1320-12b3-4ca1-b58d-74414b28bc91 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:21.612713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.613601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.613884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.614163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/ab1ffde1b21246acb7092df7616e2a11/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.616288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=ab1ffde1b21246acb7092df7616e2a11, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.617747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.650241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9b2b-2f15-4dde-9586-83ead79b65ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.650941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9b2b-2f15-4dde-9586-83ead79b65ad None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.651229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9b2b-2f15-4dde-9586-83ead79b65ad None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.651512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9b2b-2f15-4dde-9586-83ead79b65ad None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.652250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9b2b-2f15-4dde-9586-83ead79b65ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:21.652558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9b2b-2f15-4dde-9586-83ead79b65ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.653966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9b2b-2f15-4dde-9586-83ead79b65ad None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.666162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 413/810] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:21.667464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621205a-db68-4c00-97ec-4e4dd3bfbeed None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.667714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621205a-db68-4c00-97ec-4e4dd3bfbeed None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.667994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621205a-db68-4c00-97ec-4e4dd3bfbeed None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.669223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 414/811] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:21.670261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7230-5942-4b66-807e-1ad9c958d1b2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.670544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7230-5942-4b66-807e-1ad9c958d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.670853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b7230-5942-4b66-807e-1ad9c958d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.687743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1c5b7230-5942-4b66-807e-1ad9c958d1b2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:21.694986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1c5b7230-5942-4b66-807e-1ad9c958d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:21.695343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 398/812] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:21 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/ab1ffde1b21246acb7092df7616e2a11/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:21.696182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.699635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:21.777250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:21.788720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 415/813] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:21.790237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c21936-c52e-49d7-8f9c-fc3069ebfc4b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.790563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c21936-c52e-49d7-8f9c-fc3069ebfc4b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.791503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c21936-c52e-49d7-8f9c-fc3069ebfc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.815644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-10c21936-c52e-49d7-8f9c-fc3069ebfc4b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:21.817555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-10c21936-c52e-49d7-8f9c-fc3069ebfc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:21.819750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26574f7-d957-4ade-8682-1c6e5c5eac32 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:21.869851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:21.872039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:21.872336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:21.872705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:21.881590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:21.883092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:21.901370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:21.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:21.903634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:21.904358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 416/815] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:21.905212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c21936-c52e-49d7-8f9c-fc3069ebfc4b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.906588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 399/815] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:21.916107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:21.998437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:22.039202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c21936-c52e-49d7-8f9c-fc3069ebfc4b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.045529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f82ba-8e46-4cdb-be03-b912006255dc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.077485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:22.081906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.082675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.083152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.083503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.084365 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:22.084748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.085069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.086079 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.086396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.086831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.087285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.101219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 400/816] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:22.101720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:22.102311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:22.111651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:22.113273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 417/817] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:22.114107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.222534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea526f1-6cc4-460b-a1a9-076cbf706a18 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.223248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0d36-0b91-4286-a09f-e04aa4f41fe5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.260168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.260787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.260913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.261524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.261874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.262519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.262894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c7816f91ee6e489dbe9642b5bd25a454) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:22.263198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.263301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.263734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] PATH_INFO: `/v3/services/network` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.264576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.264936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.266300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.266971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:22.274100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 418/818] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/role_assignments?user.id=c7816f91ee6e489dbe9642b5bd25a454&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:22.275098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:22.281456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:22.282476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 15:12:22.283612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:22.286461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 401/819] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:22.292440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.363580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:22.407579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc88825-1376-4356-ac35-8ac13bbc8add None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.430892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a42cf-f98d-4511-b852-a84dc6b4fe98 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.456790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.458116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.458920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.459841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.461089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:22.461853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.464236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.470629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.471492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.471772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.472049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.472864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:22.473068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.474448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.477504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 419/820] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:22.484228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 402/821] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:22.484428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.486533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.590952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:22.635394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231b96e-7270-4824-9f72-c39a1e2de1c3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.638896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fab577-2db6-45dc-bc81-0f643dc0abf7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.654939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:22.680011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.680814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.681099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.681402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.682372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.683140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.683731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.684080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.685283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:22.685659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.687219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.694125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.695127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 403/822] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:22.695706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.701830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:22.717266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:22.718216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:22.719155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:22.719155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:22.719155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:22.719155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:22.719703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 420/823] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:22.726502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.845036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d35f09-35ed-4d25-a00d-202eba62dfa5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.858975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff868bd-6159-4e75-8b8d-e0dd95bdaae7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:22.874168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:22.890109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.890807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.891130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.891369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.892108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.894049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.908889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:22.909572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:22.909866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:22.910144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:22.910978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:22.911292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:22.912672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:22.925916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 421/824] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:22.931307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:22.987526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 404/825] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:23.071726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b064d7-6921-490d-aa51-9a320726729f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:23.145644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:23.146488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:23.146803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:23.147084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:23.157712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:23.159867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:23.176685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:23.178941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:23.181152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 422/826] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:12:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:23.187971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:23.235484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:23.324819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440a0ee-0c85-4d45-8d10-3dd600ff74c4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:23.363393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:23.364068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:23.364350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:23.364624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:23.365723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:23.366050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:23.367517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:23.391726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 405/827] 10.222.0.87 () {56 vars in 1149 bytes} [Wed Jul 20 15:12:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:23.399748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:23.429507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:23.503874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53a4b4-b130-4947-bd4f-40cab4184f16 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:23.540191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:23.540994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:23.541281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:23.541566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:23.552814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:23.554325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:23.572245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:23.573154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:23.574069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:23.574069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:23.574069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:23.574069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:23.574069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 423/828] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:23.579512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:23.676563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:23.685219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978750a8-3cee-4cfa-b2f8-304d7e93663a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:23.721021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5da8-1fdf-4fb6-83cd-f4d6a2a49166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:23.721742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5da8-1fdf-4fb6-83cd-f4d6a2a49166 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:23.722065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5da8-1fdf-4fb6-83cd-f4d6a2a49166 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:23.722342 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5da8-1fdf-4fb6-83cd-f4d6a2a49166 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:23.723105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5da8-1fdf-4fb6-83cd-f4d6a2a49166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:23.723415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5da8-1fdf-4fb6-83cd-f4d6a2a49166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:23.724784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5da8-1fdf-4fb6-83cd-f4d6a2a49166 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:23.737455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 406/829] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:23.742699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:23.799674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fa782-316f-44dc-9048-3bf9995550d6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:23.799967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fa782-316f-44dc-9048-3bf9995550d6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:23.808949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fa782-316f-44dc-9048-3bf9995550d6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:23.808949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 407/830] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:23.808949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36a76a-d776-4c5e-ad3c-2e94054950db None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:23.808949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36a76a-d776-4c5e-ad3c-2e94054950db None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:23.808949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36a76a-d776-4c5e-ad3c-2e94054950db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:23.825544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1b36a76a-d776-4c5e-ad3c-2e94054950db None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:23.826825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1b36a76a-d776-4c5e-ad3c-2e94054950db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:23.830690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:23.850795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40f261-e191-4afb-abe9-03665fe73132 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:23.886967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:23.888033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:23.888413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:23.888897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:23.896866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:23.898429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:23.901202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 408/831] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:23.918733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:23.919752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:23.920646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:23.923529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36a76a-d776-4c5e-ad3c-2e94054950db None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:23.926170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 424/832] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:23.931612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:24.021405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:24.041041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36a76a-d776-4c5e-ad3c-2e94054950db None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:24.059718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39019c3d-83ec-4114-93b6-23ba4ea403a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:24.082030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:24.083201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.083712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.084197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.085070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:24.086665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:24.100066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:24.101093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:24.101961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:24.109635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 409/833] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:24.110999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:24.113323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:24.114576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.115089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.115584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.116577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:24.117114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:24.118780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:24.129361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:24.133353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 425/834] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:24.139786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:24.237220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48daaa8-8044-4c9f-b416-c659247490a2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:24.243600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f340272-81d5-4e89-a173-313281531c38 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:24.273832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac3be4-b864-403c-b2f5-5b925b7174f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:24.274602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac3be4-b864-403c-b2f5-5b925b7174f6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.274923 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac3be4-b864-403c-b2f5-5b925b7174f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.275320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac3be4-b864-403c-b2f5-5b925b7174f6 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.276029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac3be4-b864-403c-b2f5-5b925b7174f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:24.276336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac3be4-b864-403c-b2f5-5b925b7174f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:24.277727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac3be4-b864-403c-b2f5-5b925b7174f6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:24.280237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d193fc-0712-4a54-8770-e75d3909bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:24.281297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d193fc-0712-4a54-8770-e75d3909bb83 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.281721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d193fc-0712-4a54-8770-e75d3909bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.282140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d193fc-0712-4a54-8770-e75d3909bb83 None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/941ae32ff5224143a43f92f7251822de/roles/b95329feed8c4f02a509b901d6e9844b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.282385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 410/835] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:24.283736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aeb94-59c4-44c8-987c-5f05380bd853 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.284022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aeb94-59c4-44c8-987c-5f05380bd853 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.284390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aeb94-59c4-44c8-987c-5f05380bd853 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.285987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 411/836] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:24.290590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aeb94-59c4-44c8-987c-5f05380bd853 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:24.300968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d193fc-0712-4a54-8770-e75d3909bb83 None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=941ae32ff5224143a43f92f7251822de, role_id=b95329feed8c4f02a509b901d6e9844b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:24.302625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d193fc-0712-4a54-8770-e75d3909bb83 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:24.303427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:24.375322 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 426/837] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:24 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/941ae32ff5224143a43f92f7251822de/roles/b95329feed8c4f02a509b901d6e9844b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:12:24.384352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935226cf-5b35-4b5b-b516-4e29db524770 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.384571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935226cf-5b35-4b5b-b516-4e29db524770 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.384923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935226cf-5b35-4b5b-b516-4e29db524770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.400323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aeb94-59c4-44c8-987c-5f05380bd853 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:24.409685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-935226cf-5b35-4b5b-b516-4e29db524770 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:24.412063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-935226cf-5b35-4b5b-b516-4e29db524770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:24.457629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:24.458315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.458600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.459193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.460008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:24.460326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:24.462748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:24.469867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 412/838] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:24.491405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:24.521236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 427/839] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:24.547044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:24.638022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:24.666850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafa0ee-f84f-4447-9229-12d63dd9d1a1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:24.702381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:24.703218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.703548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.703832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.715036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:24.723385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:24.724316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:24.725155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 413/840] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:24.732356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935226cf-5b35-4b5b-b516-4e29db524770 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:24.842825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935226cf-5b35-4b5b-b516-4e29db524770 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:24.883364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb778d3-b9bc-4eee-b981-cdc20bb1b0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:24.884102 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb778d3-b9bc-4eee-b981-cdc20bb1b0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:24.884387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb778d3-b9bc-4eee-b981-cdc20bb1b0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:24.884668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb778d3-b9bc-4eee-b981-cdc20bb1b0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:24.885476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb778d3-b9bc-4eee-b981-cdc20bb1b0a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:24.885787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb778d3-b9bc-4eee-b981-cdc20bb1b0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:24.887436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb778d3-b9bc-4eee-b981-cdc20bb1b0a4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:24.897454 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 428/841] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:24.903717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.011969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea9b69-ffa2-40e0-9204-2868404d4909 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.018801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3588-344e-43e3-a910-da7e95915c01 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.019092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3588-344e-43e3-a910-da7e95915c01 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.019426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3588-344e-43e3-a910-da7e95915c01 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.021048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 429/842] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:25.026217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948237-d5c0-41bc-a22e-1286bb3af5b0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.026508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948237-d5c0-41bc-a22e-1286bb3af5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.026832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40948237-d5c0-41bc-a22e-1286bb3af5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.045743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-40948237-d5c0-41bc-a22e-1286bb3af5b0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:25.046947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-40948237-d5c0-41bc-a22e-1286bb3af5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:25.057126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.058310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.058598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.058910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.061516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:25.074283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.076261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:25.084927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:25.097962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:25.099022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:25.100547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:25.100547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:25.100547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:25.100547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:25.100547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 414/843] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:25.108372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.138707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 430/844] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:25.162438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948237-d5c0-41bc-a22e-1286bb3af5b0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.260210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccda033-2031-44c6-ae1a-976070441591 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.272826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40948237-d5c0-41bc-a22e-1286bb3af5b0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.298429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.299750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.300133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.300496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.301325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:25.301646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.303053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:25.308855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.309676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.309958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.310235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.310925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.312280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:25.316711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 415/845] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:25.323573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:25.327506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:25.328429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:25.329269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 431/846] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Jul 20 15:12:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:25.335894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.385182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:25.387938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:25.443030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89edd0-f381-4fa1-8dd3-ebe7b83fb9cc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.474630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925f17f-cf94-43d0-8534-15dfeb71a1cd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.481896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.483029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.483519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.484078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.498564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.500495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:25.515965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.516649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.516938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.517250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.517971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:25.518283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.519679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:25.525064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:25.526021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 15:12:25.527398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:25.529038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 432/847] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:25.534430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.534880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 416/848] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:25.535971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.643260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:25.647767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b4434-6b0e-4216-9be0-0985ed4fa8a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.666703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b22d-bf81-4e3c-aee7-0494ad1a60ae None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.674540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:25.686086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.687203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.688843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.689544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.690522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:25.691109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.692706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:25.704463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 433/849] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:25.712578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.713674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.714163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.714705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.715929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:25.716514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.718266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:25.740011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 417/850] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Jul 20 15:12:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:25.746170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:25.863988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52e8b0-ac0f-4502-8515-c3ec9b7a4f86 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:25.901240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:25.902239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:25.902770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:25.903251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:25.936602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:25.975736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:25.977525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:26.082536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 434/851] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:12:26.088583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:26.195355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5b9e1-e34d-4b62-811a-26efbf216f50 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:26.235189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:26.236511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.236860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.237140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.247902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:26.249447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:26.269926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:26.271349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:26.272262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:26.272262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:26.272262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:26.272262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:26.272262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 418/852] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:26.278865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:26.344123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:26.384279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee24363-7106-47dc-8237-fc5a43dcabe5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:26.418250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198c05f-cfae-4acd-8d12-ba656aad914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:26.419025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c05f-cfae-4acd-8d12-ba656aad914d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.419316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c05f-cfae-4acd-8d12-ba656aad914d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.419596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c05f-cfae-4acd-8d12-ba656aad914d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.420344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198c05f-cfae-4acd-8d12-ba656aad914d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:26.420645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198c05f-cfae-4acd-8d12-ba656aad914d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:26.422013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198c05f-cfae-4acd-8d12-ba656aad914d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:26.439625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 435/853] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:26.441489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:26.460776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:26.559934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f597efb-281c-4a30-8639-9a7fb1b6e9de None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:26.597713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd403dd-b65f-492f-8fec-532cb696d167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:26.598950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd403dd-b65f-492f-8fec-532cb696d167 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.599446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd403dd-b65f-492f-8fec-532cb696d167 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.599921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd403dd-b65f-492f-8fec-532cb696d167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.607082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd403dd-b65f-492f-8fec-532cb696d167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:26.608746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd403dd-b65f-492f-8fec-532cb696d167 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:26.623893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3d08-6102-4196-bada-ff5ea97a8b94 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.624476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3d08-6102-4196-bada-ff5ea97a8b94 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4dd403dd-b65f-492f-8fec-532cb696d167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:26.624911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:26.625794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:26.627310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 419/854] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:26.627815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e2019-e9a2-4366-9f63-568cb31d4357 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.627815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e2019-e9a2-4366-9f63-568cb31d4357 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.628394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e2019-e9a2-4366-9f63-568cb31d4357 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.628629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3d08-6102-4196-bada-ff5ea97a8b94 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.629593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 420/855] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:26.630692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 436/856] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:26.631706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e2019-e9a2-4366-9f63-568cb31d4357 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:26.635547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880d0eb-824b-40f2-bf1b-1f150cbb25b3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.635833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880d0eb-824b-40f2-bf1b-1f150cbb25b3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.636366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880d0eb-824b-40f2-bf1b-1f150cbb25b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.657159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b880d0eb-824b-40f2-bf1b-1f150cbb25b3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:26.659686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b880d0eb-824b-40f2-bf1b-1f150cbb25b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:26.717747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:26.730506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 437/857] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:26.731837 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f14018-d328-455f-9e2f-7b87755b032b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.732127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f14018-d328-455f-9e2f-7b87755b032b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.732404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f14018-d328-455f-9e2f-7b87755b032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.748947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-74f14018-d328-455f-9e2f-7b87755b032b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:26.750093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-74f14018-d328-455f-9e2f-7b87755b032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:26.751885 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e2019-e9a2-4366-9f63-568cb31d4357 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:26.795332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:26.796586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.797104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.797738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.799656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:26.799976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:26.801423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:26.802527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:26.813889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 421/858] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:26.815101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:26.827467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 438/859] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:26.828958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f14018-d328-455f-9e2f-7b87755b032b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:26.934169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c48f8-c000-4a0f-a6c4-27e68a3df6fc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:26.935335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f14018-d328-455f-9e2f-7b87755b032b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:26.972161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:26.972830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.973115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.973394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.974229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:26.974348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=ab1ffde1b21246acb7092df7616e2a11) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:26.974537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:26.975045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:26.975329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:26.975603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:26.976010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:26.978965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:26.990670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 439/860] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:26 2022] GET /identity/v3/role_assignments?user.id=ab1ffde1b21246acb7092df7616e2a11&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:26.990670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:26.999704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:27.009739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:27.010779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:12:27.011912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:27.012555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 422/861] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:27.019142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:27.051410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:27.109542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e12c-7dc9-468a-9848-3cca4921ceb6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:27.138988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85901491-19f9-47b7-9647-1e1e033ee7c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:27.147677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:27.148511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.148758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.149149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.149879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:27.152002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:27.184484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:27.185551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.185551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.185724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.186367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:27.186706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:27.188069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:27.197332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 423/862] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:27.202878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:27.232489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 440/863] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:26 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:27.276004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:27.325536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7d526-033c-4025-8402-680f1f548f90 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:27.376100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:27.377642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.377930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.378210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.391264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:27.393983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:27.411834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:27.412794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:27.413688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:27.413688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:27.413688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:27.413688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:27.413688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 424/864] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:27.418708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:27.542155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99beb6b8-2b1f-4df4-af59-50e0b805e7a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:27.551928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:27.578186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:27.578879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.579170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.579453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.580743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:27.581053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:27.582436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:27.595360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 441/865] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:27.601014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:27.707217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db1d0-4da1-4dd0-80c4-8428988581f6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:27.714745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:27.743211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b4be-5994-4e0b-9686-9465cbad32bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:27.744134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b4be-5994-4e0b-9686-9465cbad32bd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.744434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b4be-5994-4e0b-9686-9465cbad32bd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.744716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b4be-5994-4e0b-9686-9465cbad32bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.752857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334b4be-5994-4e0b-9686-9465cbad32bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:27.754334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334b4be-5994-4e0b-9686-9465cbad32bd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7334b4be-5994-4e0b-9686-9465cbad32bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:27.771014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:27.772200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:27.773387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:27.776193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 425/866] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:12:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:27.781918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:27.856070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692976d-5396-4b61-9c2e-063988ff6e48 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.856423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692976d-5396-4b61-9c2e-063988ff6e48 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.856636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692976d-5396-4b61-9c2e-063988ff6e48 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.859256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 426/867] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:27.867991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf030da-b283-4d48-a471-bd30bcf85c62 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.868383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf030da-b283-4d48-a471-bd30bcf85c62 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.875449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf030da-b283-4d48-a471-bd30bcf85c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.886276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0bf030da-b283-4d48-a471-bd30bcf85c62 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:27.887808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0bf030da-b283-4d48-a471-bd30bcf85c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:27.893867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5942f5-7026-4b0c-aba6-5809ba413d46 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:27.932611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:27.933286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:27.933565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:27.933838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:27.934853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:27.935214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:27.936635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:27.957029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 442/868] 10.222.0.87 () {56 vars in 1149 bytes} [Wed Jul 20 15:12:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:27.960117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 427/869] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:27.962215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:27.984440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf030da-b283-4d48-a471-bd30bcf85c62 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:27.996836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:28.096603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca098c9-6384-4ff6-8f5b-c471ed3648d2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:28.108909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:28.116752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf030da-b283-4d48-a471-bd30bcf85c62 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:28.136447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:28.137398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:28.138544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:28.138544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:28.158441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:28.159717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:28.160026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:28.160371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:28.161175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:28.162626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:28.215887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:28.217426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:28.249275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:28.259245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 428/870] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:27 2022] POST /identity/v3/services => generated 269 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:28.342052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 443/871] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:27 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:12:28.349248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:28.473430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ce95-d777-4a4c-97cc-736d11960514 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:28.518925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:28.519990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:28.520491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:28.520958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:28.532325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:28.535005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:28.553714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:28.554628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:28.555545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:28.555545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:28.555545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:28.555545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:28.556288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 429/872] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:28.564021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:28.688727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1786-e165-493a-96c1-401cf8a6e7ab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:28.717115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:28.733565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:28.733565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:28.733565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:28.733565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:28.733949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:28.733949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:28.733949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:28.745009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 444/873] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:28.750396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:28.755791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:28.912621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4b28-0177-470b-81bc-28521bf27658 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:28.962899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb02c3-7b2d-481a-99fa-9fd43b449ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:28.963710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb02c3-7b2d-481a-99fa-9fd43b449ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:28.963991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb02c3-7b2d-481a-99fa-9fd43b449ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:28.964267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb02c3-7b2d-481a-99fa-9fd43b449ee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:28.977046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb02c3-7b2d-481a-99fa-9fd43b449ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:28.978486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb02c3-7b2d-481a-99fa-9fd43b449ee2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7cfb02c3-7b2d-481a-99fa-9fd43b449ee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:28.997776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:28.998721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:28.999616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:29.002678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 430/874] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:29.012439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:29.160902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a22295-9dc2-4885-9959-e5a554ef5d53 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:29.200492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487f6b-8364-4c9a-805f-4ad75cc3f520 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.200492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487f6b-8364-4c9a-805f-4ad75cc3f520 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.200492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487f6b-8364-4c9a-805f-4ad75cc3f520 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.200847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:29.200847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.200847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.201060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 431/875] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:29.201129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.204238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:29.204238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:29.204238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:29.205812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de524-cb96-4693-a1d9-cf624d8585fa None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.206380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de524-cb96-4693-a1d9-cf624d8585fa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.206380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de524-cb96-4693-a1d9-cf624d8585fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.216449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 445/876] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:29.223620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:29.227714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2b9de524-cb96-4693-a1d9-cf624d8585fa None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:29.229031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b9de524-cb96-4693-a1d9-cf624d8585fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:29.278719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:29.299421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:29.309012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 432/877] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:29.331202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de524-cb96-4693-a1d9-cf624d8585fa None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:29.336966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86529e1e-0112-45ca-b303-51db6a1fc24f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:29.371758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:29.372442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.372723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.372995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.373823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=941ae32ff5224143a43f92f7251822de) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:29.374132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:29.375584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:29.387170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 446/878] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:29 2022] GET /identity/v3/role_assignments?user.id=941ae32ff5224143a43f92f7251822de&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:29.449417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de524-cb96-4693-a1d9-cf624d8585fa None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:29.491153 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63888362-c23a-47a8-9152-98a03cf54767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:29.492441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63888362-c23a-47a8-9152-98a03cf54767 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.492937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63888362-c23a-47a8-9152-98a03cf54767 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.493425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63888362-c23a-47a8-9152-98a03cf54767 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.494312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63888362-c23a-47a8-9152-98a03cf54767 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:29.495979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63888362-c23a-47a8-9152-98a03cf54767 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-63888362-c23a-47a8-9152-98a03cf54767 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:29.510823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:29.512168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:29.513554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:29.516866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 433/879] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:29.523556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:29.552613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b498659-ff5f-40a0-acb5-da8f47b0b3a7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.553213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b498659-ff5f-40a0-acb5-da8f47b0b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.553692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b498659-ff5f-40a0-acb5-da8f47b0b3a7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.555751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 434/880] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:29.561715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2477-ccfb-4a70-8df6-b00f9e7dea48 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.562294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2477-ccfb-4a70-8df6-b00f9e7dea48 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.562821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2477-ccfb-4a70-8df6-b00f9e7dea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.581947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e49a2477-ccfb-4a70-8df6-b00f9e7dea48 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:29.583183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e49a2477-ccfb-4a70-8df6-b00f9e7dea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:29.647813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ba635-5d06-490a-aad2-0dfcde75531d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:29.652272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:29.661255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:29.671263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 435/881] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:29.695536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a2477-ccfb-4a70-8df6-b00f9e7dea48 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:29.697791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:29.698471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.698829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.699115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.699833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:29.700161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:29.701530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:29.708692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 447/882] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:29.714419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:29.822697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a2477-ccfb-4a70-8df6-b00f9e7dea48 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:29.853307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802568-a5a0-467a-9862-99c548456a2b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:29.861911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:29.863083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.863556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.864016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.865026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:29.866607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:29.880835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:29.881916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:29.882791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:29.885296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 436/883] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:29.894736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:29.894903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:29.894903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:29.894903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:29.894903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:29.895205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:29.895205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:29.895861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:29.906747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 448/884] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:29.959802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:30.012909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a268-d56b-4d43-b779-1038480066c1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:30.051271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:30.052323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:30.052789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:30.053247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:30.054248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:30.054796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:30.056401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:30.062524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 437/885] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:30.069525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:30.114249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:30.178895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02a7eb-2f6b-42e5-9a6a-e81ebddcbd54 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:30.214564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:30.215547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:30.215983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:30.216426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:30.217286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:30.217743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:30.219282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:30.225590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 449/886] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:30.231312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:30.341328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d679-dab0-47f9-9e23-b708c81626d9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:30.358362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:30.377480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3bbb8-aaef-47e5-beaf-315361ced2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:30.377718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3bbb8-aaef-47e5-beaf-315361ced2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:30.377976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3bbb8-aaef-47e5-beaf-315361ced2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:30.378256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3bbb8-aaef-47e5-beaf-315361ced2c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:30.379083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3bbb8-aaef-47e5-beaf-315361ced2c0 None admin] RBAC: Adding query filter params (interface=public, service_id=527bfc72d0ae4c07a26cac37c26d9434, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:30.379401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3bbb8-aaef-47e5-beaf-315361ced2c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:30.380777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3bbb8-aaef-47e5-beaf-315361ced2c0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:30.388929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 438/887] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:12:30 2022] GET /identity/v3/endpoints?service_id=527bfc72d0ae4c07a26cac37c26d9434&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:30.394518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:30.503822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b85f-d3ea-4e3f-a002-23b0b1a1e56b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:30.505694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:30.541070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc1f31-c802-4633-b29b-ee16c53381a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:30.541744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1f31-c802-4633-b29b-ee16c53381a8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:30.542030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1f31-c802-4633-b29b-ee16c53381a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:30.542309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc1f31-c802-4633-b29b-ee16c53381a8 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:30.543033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc1f31-c802-4633-b29b-ee16c53381a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:30.544404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc1f31-c802-4633-b29b-ee16c53381a8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:30.551018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 450/888] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:30 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:12:30.635167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b0f3-b997-4fd4-8827-21c7e8683c1d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:30.635673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b0f3-b997-4fd4-8827-21c7e8683c1d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:30.635673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8b0f3-b997-4fd4-8827-21c7e8683c1d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:30.637595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 439/889] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:30.643704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7888a-3712-4b0e-b787-9a85349b1300 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:30.644031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7888a-3712-4b0e-b787-9a85349b1300 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:30.644271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7888a-3712-4b0e-b787-9a85349b1300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:30.665944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-51d7888a-3712-4b0e-b787-9a85349b1300 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:30.667184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51d7888a-3712-4b0e-b787-9a85349b1300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:30.745951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 451/890] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:30.769254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8b0f3-b997-4fd4-8827-21c7e8683c1d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:30.875588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8b0f3-b997-4fd4-8827-21c7e8683c1d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:30.911863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:30.912905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:30.913361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:30.913800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:30.914602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:30.916144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:30.929101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:30.930259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:30.931343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:30.933790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 440/891] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Jul 20 15:12:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:30.940172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7888a-3712-4b0e-b787-9a85349b1300 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:31.042070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:31.049327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7888a-3712-4b0e-b787-9a85349b1300 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:31.084139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:31.084873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:31.085168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:31.085448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:31.086167 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:31.086476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:31.087952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:31.093074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 452/892] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:31.099433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:31.148119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:31.205863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474b17-75e4-4fc1-832c-d3476ef46ecd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:31.246440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:31.247146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:31.247431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:31.247712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:31.248428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:31.248735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:31.250113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:31.255786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 441/893] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:31.261514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:31.368557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c2016-710f-4584-87d8-e63c4cc7b241 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:31.403583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba20d4-710a-48ea-afde-011de14db3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:31.404241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba20d4-710a-48ea-afde-011de14db3cc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:31.404524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba20d4-710a-48ea-afde-011de14db3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:31.404800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba20d4-710a-48ea-afde-011de14db3cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:31.405594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba20d4-710a-48ea-afde-011de14db3cc None admin] RBAC: Adding query filter params (interface=public, service_id=5361fcd6c5264b48a2f7e75b023637d2, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:31.405914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba20d4-710a-48ea-afde-011de14db3cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:31.407323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba20d4-710a-48ea-afde-011de14db3cc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:31.412776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 453/894] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:12:31 2022] GET /identity/v3/endpoints?service_id=5361fcd6c5264b48a2f7e75b023637d2&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:31.418195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:31.544741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f3c47-0e12-4ccb-9c7c-f73d4b2aef2c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:31.555561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:31.581691 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc90a-a681-447c-a9af-f600e636a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:31.582740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc90a-a681-447c-a9af-f600e636a428 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:31.583260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc90a-a681-447c-a9af-f600e636a428 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:31.583752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc90a-a681-447c-a9af-f600e636a428 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:31.584747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafc90a-a681-447c-a9af-f600e636a428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:31.586379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafc90a-a681-447c-a9af-f600e636a428 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:31.592865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 442/895] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:31 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:12:31.672723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41fb3-75fa-4c1c-a5f6-402e752ddfa4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:31.673767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41fb3-75fa-4c1c-a5f6-402e752ddfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:31.673879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41fb3-75fa-4c1c-a5f6-402e752ddfa4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:31.675461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 454/896] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:31.683608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d1ea-0baf-4abf-ba59-ea9ee92d4eff None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:31.684126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d1ea-0baf-4abf-ba59-ea9ee92d4eff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:31.684236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d1ea-0baf-4abf-ba59-ea9ee92d4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:31.703290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-19a1d1ea-0baf-4abf-ba59-ea9ee92d4eff None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:31.704919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-19a1d1ea-0baf-4abf-ba59-ea9ee92d4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:31.785630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 443/897] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:31.809548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41fb3-75fa-4c1c-a5f6-402e752ddfa4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:31.837624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:31.922203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41fb3-75fa-4c1c-a5f6-402e752ddfa4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:31.958949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:31.960240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:31.960730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:31.961226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:31.972110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:31.980531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:31.981470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:31.982335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:31.985013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 455/898] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Jul 20 15:12:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:31.992122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1d1ea-0baf-4abf-ba59-ea9ee92d4eff None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:32.098179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1d1ea-0baf-4abf-ba59-ea9ee92d4eff None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:32.099770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:32.133676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8b7ef-c128-4889-b4e2-e96e8d8dc772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:32.134364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b7ef-c128-4889-b4e2-e96e8d8dc772 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.134675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b7ef-c128-4889-b4e2-e96e8d8dc772 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.134969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b7ef-c128-4889-b4e2-e96e8d8dc772 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.135733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8b7ef-c128-4889-b4e2-e96e8d8dc772 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:32.136049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8b7ef-c128-4889-b4e2-e96e8d8dc772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:32.137703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8b7ef-c128-4889-b4e2-e96e8d8dc772 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:32.151010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 444/899] 10.222.0.87 () {56 vars in 1115 bytes} [Wed Jul 20 15:12:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:32.153332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:32.192594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b534a-ccbb-44f7-8963-200f6b5a5aa7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.192920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b534a-ccbb-44f7-8963-200f6b5a5aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.193190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b534a-ccbb-44f7-8963-200f6b5a5aa7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.194966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 445/900] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:32.201947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18144-973c-4fc3-829b-a1ef6a36d45a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.202241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18144-973c-4fc3-829b-a1ef6a36d45a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.202525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18144-973c-4fc3-829b-a1ef6a36d45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.221291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e3d18144-973c-4fc3-829b-a1ef6a36d45a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:32.222508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e3d18144-973c-4fc3-829b-a1ef6a36d45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:32.254810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:32.275858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a76dd-ca4b-44b2-9cb5-b04b1eb70044 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:32.296495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 446/901] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:32.320697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18144-973c-4fc3-829b-a1ef6a36d45a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:32.326902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:32.328004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.328493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.329528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.345894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:32.348936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:32.372679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:32.373695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:32.374633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:32.374633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:32.374633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:32.374633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:32.378818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 456/902] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:32.380545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:32.432966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:32.441373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18144-973c-4fc3-829b-a1ef6a36d45a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:32.480261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:32.481185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.481721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.482274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.483302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:32.485131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:32.509029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ddc0f-65ab-445f-bdd1-bcafd5772041 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:32.550063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0227d8b-f378-4b64-95d5-bbda706805c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:32.550739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227d8b-f378-4b64-95d5-bbda706805c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.551029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227d8b-f378-4b64-95d5-bbda706805c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.551314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0227d8b-f378-4b64-95d5-bbda706805c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.552044 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227d8b-f378-4b64-95d5-bbda706805c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:32.552354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227d8b-f378-4b64-95d5-bbda706805c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:32.553720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0227d8b-f378-4b64-95d5-bbda706805c5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:32.556180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 447/903] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:32 2022] POST /identity/v3/services => generated 241 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:32.559233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:32.575816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 457/904] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:32.577575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:32.703934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229827fb-794b-4779-b8c4-b33bb2944e42 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:32.719130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a025-71f1-4f31-ad81-d793e687f7fe None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.721709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a025-71f1-4f31-ad81-d793e687f7fe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.722236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a025-71f1-4f31-ad81-d793e687f7fe None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.725569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 458/905] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:32.729701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5f70-63ec-436c-a964-bd7ad769a036 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.729997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5f70-63ec-436c-a964-bd7ad769a036 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.730286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5f70-63ec-436c-a964-bd7ad769a036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.751003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:32.751204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.751457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.751706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.753746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8edd5f70-63ec-436c-a964-bd7ad769a036 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:32.754958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8edd5f70-63ec-436c-a964-bd7ad769a036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:32.763839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:32.764787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:32.793755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:32.794809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:32.795782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 448/906] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:12:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:32.801530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:32.814721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:32.855344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 459/907] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:32.878203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5f70-63ec-436c-a964-bd7ad769a036 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:32.921811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea469d-e496-49f6-b8f8-15b165210f74 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:32.967228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:32.968192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:32.968597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:32.969150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:32.970093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:32.971125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:32.972861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:32.988180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5f70-63ec-436c-a964-bd7ad769a036 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:32.994231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 449/908] 10.222.0.87 () {56 vars in 1149 bytes} [Wed Jul 20 15:12:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:33.002663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.025227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:33.041250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:33.043008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.043495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.043969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.045097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:33.047607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:33.063474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:33.064871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 15:12:33.065753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:33.069981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 460/909] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:33.075408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.083088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:33.132364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395aa3f-d5be-45b9-91cb-33e329724c50 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:33.180310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:33.181863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.182296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.182802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.191577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8084db-55cd-467d-94d7-1ba1c9f6c87c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:33.230175 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:33.230944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.231345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.231708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.232530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:33.233365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:33.234389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:33.240441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 461/910] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:33.245635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.275191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:33.277861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:33.324256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:33.368229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:33.384931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27540-009d-4852-94d1-535d807fda63 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:33.421154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 450/911] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:12:33.424074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.432465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:33.433801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.434192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.434571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.435422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:33.436293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:33.438200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:33.446720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 462/912] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Jul 20 15:12:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:33.451320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.569581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c757b-1cab-40d6-b28d-22a481845dbf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:33.600873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d2c56-0ef0-4f0b-9d24-5cca14f434af None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:33.605533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:33.606338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.606623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.606932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.618017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:33.619510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:33.624184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:33.639217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:33.644987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:33.645876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:33.645876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:33.645876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:33.645876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:33.645876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 451/913] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:33.646147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217685a0-34ec-4988-ad50-ab5137ce22f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:33.647580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217685a0-34ec-4988-ad50-ab5137ce22f6 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.647580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217685a0-34ec-4988-ad50-ab5137ce22f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.647580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217685a0-34ec-4988-ad50-ab5137ce22f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.648622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.649958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217685a0-34ec-4988-ad50-ab5137ce22f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:33.651385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217685a0-34ec-4988-ad50-ab5137ce22f6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:33.674340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:33.728675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 463/914] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:33.772792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c0aeb-11d0-48bd-8ce9-8d7e9f726094 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:33.808566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8737bc-4333-4b19-a37e-d9abfcd7b717 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.808920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8737bc-4333-4b19-a37e-d9abfcd7b717 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.809127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8737bc-4333-4b19-a37e-d9abfcd7b717 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.810778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 464/915] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:33.816515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dce5c-0ee3-4507-b6e2-a16164d218f0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.816805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dce5c-0ee3-4507-b6e2-a16164d218f0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.817079 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dce5c-0ee3-4507-b6e2-a16164d218f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.821781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:33.822811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:33.823306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:33.823587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:33.824329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:33.824639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:33.826035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:33.836390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e40dce5c-0ee3-4507-b6e2-a16164d218f0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:33.837959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e40dce5c-0ee3-4507-b6e2-a16164d218f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:33.845150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 452/916] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:33.847363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.937234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 465/917] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:33.956127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:33.962344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dce5c-0ee3-4507-b6e2-a16164d218f0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:33.987502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f2504-f6c3-4689-96ca-aa5e043d5b4f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.032439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:34.034293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.035183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.035926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.045028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:34.047564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:34.068429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:34.069528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:34.070617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:34.072263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 453/918] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:34.078717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:34.085186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dce5c-0ee3-4507-b6e2-a16164d218f0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.088851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:34.125385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:34.126623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.127141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.127622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.128489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:34.130177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:34.143248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:34.144233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 15:12:34.145099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:34.152662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 466/919] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Jul 20 15:12:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:34.153786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:34.220569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a310-5dd2-41d7-8e0c-6f0aab8f4047 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.264361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b08a5-0cae-4655-b033-a2db0ebec4f4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.270198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:34.270952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.271239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.271517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.272327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:34.272621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:34.274622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:34.277859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:34.294764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 454/920] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:34.298244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:34.311622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:34.312302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.312584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.312860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.314892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:34.315448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:34.317291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:34.324250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 467/921] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:34.331636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:34.366343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:34.434972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e845912-d7eb-4df7-8abb-412c4422f7cd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.443240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f520-f113-4b45-8ebf-52064a14da7d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.476610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:34.477714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.478207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.478729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.479851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] RBAC: Adding query filter params (role.id=6381f3b1c4224727bd3b6a2f1aac1cea, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=941ae32ff5224143a43f92f7251822de) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:34.480369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:34.482149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:34.486953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570456-3e34-4caf-b91e-874c6acb7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:34.487994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570456-3e34-4caf-b91e-874c6acb7653 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.488340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570456-3e34-4caf-b91e-874c6acb7653 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.488678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570456-3e34-4caf-b91e-874c6acb7653 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.489445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570456-3e34-4caf-b91e-874c6acb7653 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:34.492948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570456-3e34-4caf-b91e-874c6acb7653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:34.494663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570456-3e34-4caf-b91e-874c6acb7653 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:34.497299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 455/922] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:34 2022] GET /identity/v3/role_assignments?user.id=941ae32ff5224143a43f92f7251822de&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=6381f3b1c4224727bd3b6a2f1aac1cea => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:34.500908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 468/923] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:34.508426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:34.580446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:34.628820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da3e1f-e70e-4fe4-9de6-e9b17631f837 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.667011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf698-3844-426a-9856-60f4048008ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:34.667954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf698-3844-426a-9856-60f4048008ba None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.668393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf698-3844-426a-9856-60f4048008ba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.668823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf698-3844-426a-9856-60f4048008ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.669731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf698-3844-426a-9856-60f4048008ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:34.671409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf698-3844-426a-9856-60f4048008ba None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:34.708242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b78b8f-2c6d-4fb6-add9-2d884e526762 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.708533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b78b8f-2c6d-4fb6-add9-2d884e526762 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.709038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b78b8f-2c6d-4fb6-add9-2d884e526762 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.710403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 469/924] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:34.715505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c468cc-9e4c-42a0-9c65-c6b6d2393583 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:34.715798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c468cc-9e4c-42a0-9c65-c6b6d2393583 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:34.716078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c468cc-9e4c-42a0-9c65-c6b6d2393583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:34.733422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-94c468cc-9e4c-42a0-9c65-c6b6d2393583 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:34.734604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-94c468cc-9e4c-42a0-9c65-c6b6d2393583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:34.775261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 456/925] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:34.826339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 470/926] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:34.850736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf698-3844-426a-9856-60f4048008ba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:34.968878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf698-3844-426a-9856-60f4048008ba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:34.990495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:35.008091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:35.008908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:35.009195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:35.009474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:35.010196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:35.011934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:35.025088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:35.026133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:35.027002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 457/927] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:35.037783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c468cc-9e4c-42a0-9c65-c6b6d2393583 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:35.062976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:35.144517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c468cc-9e4c-42a0-9c65-c6b6d2393583 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:35.180023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:35.180693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:35.180976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:35.181252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:35.181964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:35.182267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:35.183660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:35.188763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 471/928] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:35.194420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:35.309024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d5e79-1807-4293-a5ad-a92cc5c70544 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:35.344919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:35.345627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:35.345917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:35.346198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:35.346952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:35.347266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:35.348733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:35.358764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 458/929] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:35.360427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:35.448665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:35.463356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a265-b71d-46f2-916a-aff1c6ca8593 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:35.502945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1546-1765-4d58-89b8-c94bf4cedb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:35.503615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1546-1765-4d58-89b8-c94bf4cedb85 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:35.503900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1546-1765-4d58-89b8-c94bf4cedb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:35.504178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1546-1765-4d58-89b8-c94bf4cedb85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:35.504983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1546-1765-4d58-89b8-c94bf4cedb85 None admin] RBAC: Adding query filter params (interface=public, service_id=50645074d9cf4357baf27d6232ad32d1, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:35.505298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1546-1765-4d58-89b8-c94bf4cedb85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:35.506692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1546-1765-4d58-89b8-c94bf4cedb85 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:35.512723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 472/930] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:12:35 2022] GET /identity/v3/endpoints?service_id=50645074d9cf4357baf27d6232ad32d1&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:35.518790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:35.579189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:35.624198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a094b5-aed4-4ed7-a56c-069e81eac1e2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:35.660098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7a3ff-30ac-4171-9dde-4b19ebaefb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:35.661284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7a3ff-30ac-4171-9dde-4b19ebaefb6d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:35.662326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7a3ff-30ac-4171-9dde-4b19ebaefb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:35.662606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7a3ff-30ac-4171-9dde-4b19ebaefb6d None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:35.663335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7a3ff-30ac-4171-9dde-4b19ebaefb6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:35.664717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7a3ff-30ac-4171-9dde-4b19ebaefb6d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:35.674779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 459/931] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:35 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:12:35.935849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5b585-67ce-46be-8a63-83a15a0ec926 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:35.936410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5b585-67ce-46be-8a63-83a15a0ec926 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:35.936410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5b585-67ce-46be-8a63-83a15a0ec926 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:35.938060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 473/932] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:35.944249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bea915-ab90-40d7-8140-9382c430cc5a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:35.944746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bea915-ab90-40d7-8140-9382c430cc5a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:35.944854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bea915-ab90-40d7-8140-9382c430cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:35.961634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-95bea915-ab90-40d7-8140-9382c430cc5a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:35.962859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-95bea915-ab90-40d7-8140-9382c430cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:36.035451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 460/933] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:36.058878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5b585-67ce-46be-8a63-83a15a0ec926 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:36.163186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5b585-67ce-46be-8a63-83a15a0ec926 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:36.200460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:36.201056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:36.201343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:36.201621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:36.202328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:36.203804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:36.205205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING keystone.server.flask.common [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 15:12:36.260211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.sql.core [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 15:12:36.260211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 15:12:36.260211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [parameters: {'id': '9f5e6bab76f648d4b1ec899f2e5f9e42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 15:12:36.260211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f5e6bab76f648d4b1ec899f2e5f9e42.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f5e6bab76f648d4b1ec899f2e5f9e42. Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:12:36.277644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 15:12:36.278506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application yield resource Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise self.value Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application session.commit() Jul 20 15:12:36.279536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.flush() Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application compat.raise_( Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 15:12:36.280452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 15:12:36.281399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:12:36.282243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [parameters: {'id': '9f5e6bab76f648d4b1ec899f2e5f9e42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:36.285070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:36.286100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9f5e6bab76f648d4b1ec899f2e5f9e42. Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:36.287303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 474/934] 10.222.0.87 () {60 vars in 1140 bytes} [Wed Jul 20 15:12:36 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:36.288014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bea915-ab90-40d7-8140-9382c430cc5a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:36.343039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:36.394565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bea915-ab90-40d7-8140-9382c430cc5a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:36.431487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853362c8-feba-4e2b-afe2-e85381ae501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:36.432294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853362c8-feba-4e2b-afe2-e85381ae501e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:36.432581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853362c8-feba-4e2b-afe2-e85381ae501e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:36.432863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853362c8-feba-4e2b-afe2-e85381ae501e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:36.439876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853362c8-feba-4e2b-afe2-e85381ae501e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:36.441331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853362c8-feba-4e2b-afe2-e85381ae501e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-853362c8-feba-4e2b-afe2-e85381ae501e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:36.455445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:36.457346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:36.459522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 461/935] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:36.464251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:36.475662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:36.574350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e98cc9-8505-479d-b489-65fe9871d994 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:36.609751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea3fe8-48aa-43a0-81cf-7cad767e94e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:36.610421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3fe8-48aa-43a0-81cf-7cad767e94e9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:36.611267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3fe8-48aa-43a0-81cf-7cad767e94e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:36.611558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea3fe8-48aa-43a0-81cf-7cad767e94e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:36.612330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea3fe8-48aa-43a0-81cf-7cad767e94e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:36.612643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea3fe8-48aa-43a0-81cf-7cad767e94e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:36.614290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea3fe8-48aa-43a0-81cf-7cad767e94e9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:36.635665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 475/936] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:36.742605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a2f2-b9fa-44ff-b7fb-cb2da28a3f84 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:36.742981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a2f2-b9fa-44ff-b7fb-cb2da28a3f84 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:36.743180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39a2f2-b9fa-44ff-b7fb-cb2da28a3f84 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:36.744820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 462/937] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:36.751124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4b68-ba15-4de7-b5d9-f0a3770b9502 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:36.751458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4b68-ba15-4de7-b5d9-f0a3770b9502 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:36.751729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c4b68-ba15-4de7-b5d9-f0a3770b9502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:36.771373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d39c4b68-ba15-4de7-b5d9-f0a3770b9502 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:36.773008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d39c4b68-ba15-4de7-b5d9-f0a3770b9502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:36.838042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:36.848690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 476/938] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:36.870787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a2f2-b9fa-44ff-b7fb-cb2da28a3f84 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:36.983479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:36.988567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39a2f2-b9fa-44ff-b7fb-cb2da28a3f84 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:36.998410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ad4b2-dbfe-4707-a185-6d984c15d052 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:36.998930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ad4b2-dbfe-4707-a185-6d984c15d052 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:36.998930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ad4b2-dbfe-4707-a185-6d984c15d052 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.000603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 477/939] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:37.006591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462745c-3a5f-43ae-bcea-9a5dd5b93068 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.006905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462745c-3a5f-43ae-bcea-9a5dd5b93068 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.007357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462745c-3a5f-43ae-bcea-9a5dd5b93068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.026815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.027643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.027927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.028206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.030547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9462745c-3a5f-43ae-bcea-9a5dd5b93068 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:37.032176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9462745c-3a5f-43ae-bcea-9a5dd5b93068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:37.039549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:37.047799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:37.049439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:37.050305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 463/940] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Jul 20 15:12:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:37.056352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.123497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 478/941] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:37.146174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462745c-3a5f-43ae-bcea-9a5dd5b93068 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.188861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5934d-028a-448e-8673-6420897f7296 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:37.235104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.236922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.237412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.238820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.239885 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:37.240390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:37.241954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:37.254041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 464/942] 10.222.0.87 () {56 vars in 1115 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:37.260777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.279442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462745c-3a5f-43ae-bcea-9a5dd5b93068 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:37.290811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:37.315988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:37.325892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.327058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.327586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.328068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.328936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:37.331124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:37.343737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:37.351625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:37.352493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:37.354085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 479/943] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:37.355688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.385169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f6b7b-7443-4cb9-a6e1-3ece32d8e2fb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:37.421879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.422711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.423002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.423913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.434780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:37.436299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:37.455841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:37.456830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:37.457753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:37.457753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:37.457753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:37.457753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:37.461921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 465/944] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:37.463326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.469680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437470f-b798-4c7f-b121-665b420c6bde None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:37.518823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.519821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.520326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.520811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.521735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:37.522266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:37.523907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:37.534168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 480/945] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:37.535278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.553524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:37.592606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737e8c-ece3-43b6-9d8a-a58c1a6057c9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:37.596335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:37.636890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.637565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.637852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.638255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.639060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:37.639373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:37.641364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:37.647078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ac845-a345-4384-a6a9-25a2395620cf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:37.661691 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 466/946] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:37.663420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.687410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d113f-cde0-4ea3-aa5f-97702e6d10f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.688424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d113f-cde0-4ea3-aa5f-97702e6d10f4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.689512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d113f-cde0-4ea3-aa5f-97702e6d10f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.689998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d113f-cde0-4ea3-aa5f-97702e6d10f4 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.691021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d113f-cde0-4ea3-aa5f-97702e6d10f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:37.691537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d113f-cde0-4ea3-aa5f-97702e6d10f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:37.693124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d113f-cde0-4ea3-aa5f-97702e6d10f4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:37.706975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 481/947] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:37.785192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ce5b2-216d-4d60-893d-2ecd807e5f40 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:37.813714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37f379-1708-401e-a9eb-bdbd259e1d6f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.814858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37f379-1708-401e-a9eb-bdbd259e1d6f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.815499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37f379-1708-401e-a9eb-bdbd259e1d6f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.817487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 482/948] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:37.823383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:37.824585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab62ef-b0d8-4b04-bdda-d400e2478c50 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.824803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab62ef-b0d8-4b04-bdda-d400e2478c50 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.825877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab62ef-b0d8-4b04-bdda-d400e2478c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.831754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:37.833104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:37.833667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:37.834134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:37.843789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:37.846237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:37.847008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-99ab62ef-b0d8-4b04-bdda-d400e2478c50 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:37.848387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-99ab62ef-b0d8-4b04-bdda-d400e2478c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:37.865525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:37.866546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:37.867996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 467/949] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:37.872637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.945190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 483/950] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:37.964135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab62ef-b0d8-4b04-bdda-d400e2478c50 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:37.986602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72455c2d-f136-40fe-a565-51960f97ec15 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.020864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:38.021379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.021764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.022050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.022331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.023398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:38.023709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.025142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.043791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 468/951] 10.222.0.87 () {56 vars in 1149 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:38.050350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.071508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab62ef-b0d8-4b04-bdda-d400e2478c50 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.101790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:38.110288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.111738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.112205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.112645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.113463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.115024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:38.127962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:38.129204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:38.130135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:38.138912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 484/952] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:38.140060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.155062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5766ee-3104-466f-a112-464f2bd7e6d9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.195255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.196090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.196411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.196690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.207424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.208881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:38.227532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:38.228567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:38.229533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:38.229533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:38.229533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:38.229533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:38.234213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 469/953] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:38.235177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.257537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee11e-5e67-49e5-897e-994e29b683c4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.279032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:38.294336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.295094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.305368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.305368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.305368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:38.305368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.305368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.305368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 485/954] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:38.309954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.340009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69d015-f018-440c-bff0-621397e74df2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.341652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:38.377261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.378033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.378384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.378762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.379605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:38.380296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.382132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.398909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 470/955] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:38.400990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.436017 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195e1a8-cb05-4c54-bce5-3ad188ad3983 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.482192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.483119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.483445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.483827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.485072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:38.485072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.487377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.500057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 486/956] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:38.501098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.535537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0510e6-6a85-42d9-a2ac-f9c9e082ec8e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.570608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:38.574440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.575565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.575952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.576353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.587176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.590781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:38.612967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:38.613929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:38.614949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:38.619218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 471/957] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:38.620470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.630723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c8d03-9929-4711-97ff-395bd96645e7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.654101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:38.680773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.682484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.683039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.683501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.684698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.687094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.742773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04a9e-a653-4c90-b381-f52559d96236 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.786167 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 487/958] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:38.792906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289abb8-e41a-4fda-904f-1ca63637ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:38.793727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289abb8-e41a-4fda-904f-1ca63637ed63 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.793949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289abb8-e41a-4fda-904f-1ca63637ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.794273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289abb8-e41a-4fda-904f-1ca63637ed63 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.795200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289abb8-e41a-4fda-904f-1ca63637ed63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:38.795515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289abb8-e41a-4fda-904f-1ca63637ed63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:38.797291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289abb8-e41a-4fda-904f-1ca63637ed63 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:38.811663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 472/959] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:38.831870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:38.841056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1676-0f7c-43bc-a955-05ec0507c610 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.843411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1676-0f7c-43bc-a955-05ec0507c610 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.843411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1676-0f7c-43bc-a955-05ec0507c610 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.843411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 473/960] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:38.849183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd3ac-43d9-4011-a734-0eae7238fa6a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:38.849512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd3ac-43d9-4011-a734-0eae7238fa6a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:38.849747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bd3ac-43d9-4011-a734-0eae7238fa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:38.869379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d78bd3ac-43d9-4011-a734-0eae7238fa6a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:38.870732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d78bd3ac-43d9-4011-a734-0eae7238fa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:38.952245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 474/961] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:38.962876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:38.969851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a2cc4-f7a3-4dd2-a3e1-ee021a8ee804 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:38.986605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bd3ac-43d9-4011-a734-0eae7238fa6a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:39.001099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:39.017869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:39.018841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:39.019109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:39.022559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/941ae32ff5224143a43f92f7251822de/roles/6381f3b1c4224727bd3b6a2f1aac1cea` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:39.022559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=941ae32ff5224143a43f92f7251822de, role_id=6381f3b1c4224727bd3b6a2f1aac1cea)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:39.023923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:39.095411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bd3ac-43d9-4011-a734-0eae7238fa6a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:39.135895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 488/962] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:38 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/941ae32ff5224143a43f92f7251822de/roles/6381f3b1c4224727bd3b6a2f1aac1cea => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:39.137073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:39.137985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:39.138428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:39.138934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:39.139926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:39.141622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:39.143334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING keystone.server.flask.common [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 15:12:39.192158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.sql.core [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 15:12:39.192158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 15:12:39.192158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [parameters: {'user_id': '6fa91b57f435421eb72d321884d38b7c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 15:12:39.192158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 20 15:12:39.200969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:12:39.202190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application yield resource Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise self.value Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application session.commit() Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 15:12:39.203384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.flush() Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application compat.raise_( Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 15:12:39.204600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 15:12:39.205697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 15:12:39.206822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [parameters: {'user_id': '6fa91b57f435421eb72d321884d38b7c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:39.209354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 15:12:39.210349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 15:12:39.211494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 15:12:39.211494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 15:12:39.211494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 15:12:39.211494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 15:12:39.211494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 15:12:39.211494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:39.211494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 475/963] 10.222.0.87 () {60 vars in 1131 bytes} [Wed Jul 20 15:12:38 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:39.215296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:39.334270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343809-2d5e-4094-a946-e3bef10be47e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:39.370476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddcb14-5bb7-4870-9cf2-76d5400804a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:39.371225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddcb14-5bb7-4870-9cf2-76d5400804a2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:39.371508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddcb14-5bb7-4870-9cf2-76d5400804a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:39.371780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddcb14-5bb7-4870-9cf2-76d5400804a2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:39.380105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddcb14-5bb7-4870-9cf2-76d5400804a2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:39.381546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddcb14-5bb7-4870-9cf2-76d5400804a2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-59ddcb14-5bb7-4870-9cf2-76d5400804a2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:39.396989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:39.397973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:39.399012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 489/964] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:39.404419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:39.478379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:39.512712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5312d-637d-4f84-888b-41eb07c4a44c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:39.549493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da78e34-dde6-41e5-bca3-c8cf820a2077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:39.550166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da78e34-dde6-41e5-bca3-c8cf820a2077 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:39.550446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da78e34-dde6-41e5-bca3-c8cf820a2077 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:39.550747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da78e34-dde6-41e5-bca3-c8cf820a2077 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:39.551558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da78e34-dde6-41e5-bca3-c8cf820a2077 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:39.551864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da78e34-dde6-41e5-bca3-c8cf820a2077 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:39.553544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da78e34-dde6-41e5-bca3-c8cf820a2077 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:39.598821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 476/965] 10.222.0.87 () {56 vars in 1101 bytes} [Wed Jul 20 15:12:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:39.895106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bd35-e4d9-45f3-8082-83afa4207baa None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:39.895491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bd35-e4d9-45f3-8082-83afa4207baa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:39.895715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bd35-e4d9-45f3-8082-83afa4207baa None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:39.897033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 490/966] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:39.902569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc591-c3b1-48a2-b5a2-44a5982e7e6a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:39.902899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc591-c3b1-48a2-b5a2-44a5982e7e6a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:39.903183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc591-c3b1-48a2-b5a2-44a5982e7e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:39.920908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b15bc591-c3b1-48a2-b5a2-44a5982e7e6a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:39.922782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b15bc591-c3b1-48a2-b5a2-44a5982e7e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:39.993690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 477/967] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:40.017133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660bd35-e4d9-45f3-8082-83afa4207baa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:40.035987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:40.120597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660bd35-e4d9-45f3-8082-83afa4207baa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:40.155114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a338b-01b7-4b0b-8b00-b444917af949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:40.156004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a338b-01b7-4b0b-8b00-b444917af949 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:40.156436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a338b-01b7-4b0b-8b00-b444917af949 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:40.156863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a338b-01b7-4b0b-8b00-b444917af949 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:40.158215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a338b-01b7-4b0b-8b00-b444917af949 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:40.159925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a338b-01b7-4b0b-8b00-b444917af949 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:40.238447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 491/968] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:40 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:40.946086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dfe59-705b-406c-97e0-09bbb7b6122f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:40.946489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dfe59-705b-406c-97e0-09bbb7b6122f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:40.946697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dfe59-705b-406c-97e0-09bbb7b6122f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:40.948113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 478/969] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:40.953456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145cab-199b-4da4-b2ed-4e4f02ced40a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:40.953754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145cab-199b-4da4-b2ed-4e4f02ced40a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:40.954034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145cab-199b-4da4-b2ed-4e4f02ced40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:40.971632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ef145cab-199b-4da4-b2ed-4e4f02ced40a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:40.972821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef145cab-199b-4da4-b2ed-4e4f02ced40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:41.050113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 492/970] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:41.072709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dfe59-705b-406c-97e0-09bbb7b6122f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.132881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.176385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dfe59-705b-406c-97e0-09bbb7b6122f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.210985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.211723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.212014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.212293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.212945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.214305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.225367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481f4a-f949-4f06-bf34-a044f4ed1580 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.225659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481f4a-f949-4f06-bf34-a044f4ed1580 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.225941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481f4a-f949-4f06-bf34-a044f4ed1580 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:41.226393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:41.227423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:41.228291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:41.229053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 493/971] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:41.230933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 479/972] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:41.233723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.233894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66dfad-a390-4869-9dc0-7a80169e2838 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.234146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66dfad-a390-4869-9dc0-7a80169e2838 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.234351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66dfad-a390-4869-9dc0-7a80169e2838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.240579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.254263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5f66dfad-a390-4869-9dc0-7a80169e2838 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:41.256202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f66dfad-a390-4869-9dc0-7a80169e2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:41.339273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 494/973] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:41.342928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd75f-f37f-4593-bd1d-72e82c363acf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.362938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66dfad-a390-4869-9dc0-7a80169e2838 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.366959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.379869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.380545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.380910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.381191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.381910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:41.382223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.383630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.389500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 480/974] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:41.396003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.483805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66dfad-a390-4869-9dc0-7a80169e2838 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.508179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cd646-9871-40c2-8268-7a0015a4ea0d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.521654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.527426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.528288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.528521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.528795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.539299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:41.545923 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.546757 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.547131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.547515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:41.547616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:41.548573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:41.554801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:41.555479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:41.555479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.555609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 495/975] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:41.555677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.555753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.560362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 481/976] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:41.567061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.621388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.667657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b503877-59c9-48b1-9080-92a8cfe3cb4f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.672753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7549-cdf8-4d5b-85ea-befeeb6143cb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.703139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.703806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.704091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.705072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.705718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:41.706043 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.707239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.707445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.707893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.708175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.708449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.709246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] RBAC: Adding query filter params (interface=admin, service_id=50645074d9cf4357baf27d6232ad32d1, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:41.709563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.710935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.716039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 496/977] 10.222.0.87 () {56 vars in 1115 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:41.716176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 482/978] 10.222.0.87 () {56 vars in 1249 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/endpoints?service_id=50645074d9cf4357baf27d6232ad32d1&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:41.721907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.723979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:41.779341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.827255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdad8e-f8cd-4caa-a305-607348f1e6a6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.839276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78107736-a8be-4b79-8479-267c2b129afe None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:41.856105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:41.864522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.865330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.866969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.866969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.877666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.878511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:41.879147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.879549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:41.879797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:41.880060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:41.880742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:41.882586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:41.898668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 483/979] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:41.898913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:41.899961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:41.901070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:41.901070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:41.901070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:41.901070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:41.901070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 497/980] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:41.904013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.014939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c122-6ba0-40b0-a74e-4215a317e96a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.053007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.053588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.053872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.054149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.054973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:42.055283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.056871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.069814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 484/981] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:42.075243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.180456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42963d5-9368-4527-9795-62eb43b5ce41 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.187603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:42.215741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08298a15-dc35-489e-814f-dddd65499832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.216560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08298a15-dc35-489e-814f-dddd65499832 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.216850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08298a15-dc35-489e-814f-dddd65499832 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.217129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08298a15-dc35-489e-814f-dddd65499832 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.225949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08298a15-dc35-489e-814f-dddd65499832 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.227416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08298a15-dc35-489e-814f-dddd65499832 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-08298a15-dc35-489e-814f-dddd65499832 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:42.242946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:42.243917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:42.244880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 498/982] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:42.251697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.294102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:42.346038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0186-ad0c-4a26-9fea-146caeae0c80 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.346329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0186-ad0c-4a26-9fea-146caeae0c80 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.346614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0186-ad0c-4a26-9fea-146caeae0c80 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.348244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 499/983] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:42.353136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a43f-f64b-4a97-aa93-cf99b5ac8e29 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.353430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a43f-f64b-4a97-aa93-cf99b5ac8e29 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.353713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a43f-f64b-4a97-aa93-cf99b5ac8e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.354841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb312d98-4b12-4520-b545-73ba260ddefa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.371094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5de1a43f-f64b-4a97-aa93-cf99b5ac8e29 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:42.372283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5de1a43f-f64b-4a97-aa93-cf99b5ac8e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:42.394413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.395120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.395408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.395685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.396519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:42.396828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.398252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.420119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 485/984] 10.222.0.87 () {56 vars in 1149 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:42.421466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.450675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 500/985] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:42.470375 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1a43f-f64b-4a97-aa93-cf99b5ac8e29 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.533102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:42.539194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fa440-6f0a-49eb-8576-d66be7616a8a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.573815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:42.576082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.576804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.577095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.577534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.580845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1a43f-f64b-4a97-aa93-cf99b5ac8e29 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.618701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.619689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.619689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.619996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.620631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.622108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:42.634737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:42.635773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:42.636909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 501/986] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:42.642123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.654100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.656056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.753880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c3571-b71d-449c-be54-f77f23915054 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.760411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:42.768911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 486/987] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:12:42.774816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.790801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.791547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.791899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.792254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.793040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:42.793419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.794880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.800541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 502/988] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:42.806346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.838892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:42.884998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ea9aa-ac9f-4cc6-ad34-07909f73b8c5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.920767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb72ad-6542-4dca-86ed-46b7600fc505 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:42.925839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.926782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.927172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.927551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.938351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.939870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.957989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:42.958432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:42.959492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:42.960428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:42.960428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:42.960428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:42.960428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:42.960664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:42.960664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:42.960664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:42.960873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 487/989] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:42.960952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:42.960952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:42.964033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:42.966946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:42.971807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 503/990] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:42.978305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:43.023158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:43.075725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:43.079777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270a16-7b48-46e0-a0a9-644e276050d7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:43.088377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f42bc3-510e-4399-8fcb-6338b75799ef None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:43.118420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:43.119107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.119390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.119671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.120389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:43.120699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:43.122064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:43.127235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:43.127901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.128188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.128839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.129257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] RBAC: Adding query filter params (interface=public, service_id=252ec73800db4e9290b362e8b954f225, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:43.129572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:43.130956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:43.138439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 488/991] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:43.139420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:43.140752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 504/992] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:12:42 2022] GET /identity/v3/endpoints?service_id=252ec73800db4e9290b362e8b954f225&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:43.146321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:43.242369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9702a-ebee-4d9a-b16d-d27f29997cf4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:43.251176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:43.255443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82ddee-0882-42b2-8531-917ba03739fe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:43.277150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:43.278224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.278498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.278956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.286702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:43.288148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:43.291252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:43.291920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.292207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.292491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.293206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:43.294562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:43.301897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 505/993] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:43 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:43.302935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:43.303801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:43.305267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 489/994] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:43.310011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:43.335790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:43.429063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48ce0d-2ea1-4b9a-9c5a-85bb70f5efc2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:43.467377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15e8d5-4b55-44b3-a99c-a18d5daed273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:43.468054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e8d5-4b55-44b3-a99c-a18d5daed273 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.468340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e8d5-4b55-44b3-a99c-a18d5daed273 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.468619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e8d5-4b55-44b3-a99c-a18d5daed273 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.469414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15e8d5-4b55-44b3-a99c-a18d5daed273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:43.469730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15e8d5-4b55-44b3-a99c-a18d5daed273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:43.471229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15e8d5-4b55-44b3-a99c-a18d5daed273 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:43.483305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 506/995] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:43.493379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:43.601869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f34c-cc79-4f0c-814c-15168fa91370 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:43.637246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f13059-c39d-4920-bc42-a22a3b652cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:43.637900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f13059-c39d-4920-bc42-a22a3b652cac None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.638179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f13059-c39d-4920-bc42-a22a3b652cac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.638451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f13059-c39d-4920-bc42-a22a3b652cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.639316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f13059-c39d-4920-bc42-a22a3b652cac None admin] RBAC: Adding query filter params (role.id=6381f3b1c4224727bd3b6a2f1aac1cea, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=941ae32ff5224143a43f92f7251822de) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:43.639635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f13059-c39d-4920-bc42-a22a3b652cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:43.641066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f13059-c39d-4920-bc42-a22a3b652cac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:43.650719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 490/996] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:43 2022] GET /identity/v3/role_assignments?user.id=941ae32ff5224143a43f92f7251822de&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=6381f3b1c4224727bd3b6a2f1aac1cea => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:43.965671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c61b-6471-4a37-b683-5d1fa346d8f6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.966027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c61b-6471-4a37-b683-5d1fa346d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.966242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4c61b-6471-4a37-b683-5d1fa346d8f6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.967833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 507/997] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:43.973020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c18f7-cb82-4d58-823c-4cdc3c6329d2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:43.973522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c18f7-cb82-4d58-823c-4cdc3c6329d2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:43.973870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c18f7-cb82-4d58-823c-4cdc3c6329d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:43.990938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-334c18f7-cb82-4d58-823c-4cdc3c6329d2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:43.992114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-334c18f7-cb82-4d58-823c-4cdc3c6329d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:44.020948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:44.070669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 491/998] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:44.088620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c61b-6471-4a37-b683-5d1fa346d8f6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:44.170778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:44.195347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4c61b-6471-4a37-b683-5d1fa346d8f6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:44.229687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:44.230416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:44.230722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:44.231002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:44.231654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:44.233006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:44.244972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:44.245959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:44.255033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 508/999] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Jul 20 15:12:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:44.256044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c18f7-cb82-4d58-823c-4cdc3c6329d2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:44.356217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c18f7-cb82-4d58-823c-4cdc3c6329d2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:44.390597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:44.391296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:44.391581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:44.392398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:44.393165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:44.393472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:44.394861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:44.404420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 492/1000] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:44.405479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:44.521887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04186d92-20b6-4312-85ce-07f34896332d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:44.554664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c8f21-5fca-451c-bef7-b894e018bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:44.555388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c8f21-5fca-451c-bef7-b894e018bf27 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:44.555677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c8f21-5fca-451c-bef7-b894e018bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:44.555955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c8f21-5fca-451c-bef7-b894e018bf27 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:44.556660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c8f21-5fca-451c-bef7-b894e018bf27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:44.556969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c8f21-5fca-451c-bef7-b894e018bf27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:44.558328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c8f21-5fca-451c-bef7-b894e018bf27 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:44.563344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 509/1001] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Jul 20 15:12:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:44.569285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:44.597063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:44.667930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40bf69-ea69-4118-925e-8c322489253f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:44.701205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb234-fb40-464c-8b6f-8f163c256412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:44.701855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb234-fb40-464c-8b6f-8f163c256412 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:44.702139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb234-fb40-464c-8b6f-8f163c256412 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:44.702417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb234-fb40-464c-8b6f-8f163c256412 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:44.703198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb234-fb40-464c-8b6f-8f163c256412 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:44.705146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb234-fb40-464c-8b6f-8f163c256412 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:44.770105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 493/1002] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:45.403919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f2439-c474-4b7c-a801-abda13dab201 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:45.404451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f2439-c474-4b7c-a801-abda13dab201 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:45.404560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f2439-c474-4b7c-a801-abda13dab201 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:45.406000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 510/1003] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:45.411835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97c9b-986a-43de-bd5f-38cec79056fc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:45.412235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97c9b-986a-43de-bd5f-38cec79056fc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:45.412413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97c9b-986a-43de-bd5f-38cec79056fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:45.429901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bce97c9b-986a-43de-bd5f-38cec79056fc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:45.431132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bce97c9b-986a-43de-bd5f-38cec79056fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:45.513886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 494/1004] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:45.537133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f2439-c474-4b7c-a801-abda13dab201 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:45.541085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:45.645735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f2439-c474-4b7c-a801-abda13dab201 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:45.681407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f301f-ed1a-485e-b4aa-1695724bc0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:45.682119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f301f-ed1a-485e-b4aa-1695724bc0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:45.682403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f301f-ed1a-485e-b4aa-1695724bc0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:45.682712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f301f-ed1a-485e-b4aa-1695724bc0c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:45.683371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f301f-ed1a-485e-b4aa-1695724bc0c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:45.684737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f301f-ed1a-485e-b4aa-1695724bc0c6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2f4f301f-ed1a-485e-b4aa-1695724bc0c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:45.697097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:45.698116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:45.699009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 511/1005] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:45.705895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce97c9b-986a-43de-bd5f-38cec79056fc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:45.720918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:45.754513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532c34-e758-4bc1-be2b-7d078247542a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:45.754880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532c34-e758-4bc1-be2b-7d078247542a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:45.755112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532c34-e758-4bc1-be2b-7d078247542a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:45.756505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 512/1006] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:45.762287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1bd90-5aa6-4c9e-bf8b-567f39ea1b65 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:45.762415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1bd90-5aa6-4c9e-bf8b-567f39ea1b65 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:45.762666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1bd90-5aa6-4c9e-bf8b-567f39ea1b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:45.779833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2ed1bd90-5aa6-4c9e-bf8b-567f39ea1b65 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:45.780996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2ed1bd90-5aa6-4c9e-bf8b-567f39ea1b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:45.811775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce97c9b-986a-43de-bd5f-38cec79056fc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:45.848201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:45.854119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:45.854477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 513/1007] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:45.859520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:45.859853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:45.860138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:45.861624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:45.863915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:45.863915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:45.870196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 495/1008] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:45.874368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1bd90-5aa6-4c9e-bf8b-567f39ea1b65 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:45.877958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:45.970531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:45.985760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1bd90-5aa6-4c9e-bf8b-567f39ea1b65 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:45.996390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc65fd2-0748-4837-ac63-8e1630a3e6ca None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:46.025351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:46.026243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.026535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.026848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.027559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:46.027867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:46.029227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:46.034371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:46.034994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 514/1009] 10.222.0.87 () {56 vars in 1112 bytes} [Wed Jul 20 15:12:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:46.035213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.035527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.035809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.036472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:46.037835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:46.040253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:46.050615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:46.051655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:46.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 496/1010] 10.222.0.87 () {56 vars in 1105 bytes} [Wed Jul 20 15:12:45 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:46.057445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:46.107977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:46.148893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2732-42aa-42ed-a37e-579b30d305ab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:46.170094 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26449a83-a985-4af4-84bd-8b2fa4c8c7e0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:46.185445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb89245-a2e2-436f-b66a-c7c4bc803ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:46.186105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89245-a2e2-436f-b66a-c7c4bc803ce2 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.186391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89245-a2e2-436f-b66a-c7c4bc803ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.186694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89245-a2e2-436f-b66a-c7c4bc803ce2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.187436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb89245-a2e2-436f-b66a-c7c4bc803ce2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:46.188867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb89245-a2e2-436f-b66a-c7c4bc803ce2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:46.205329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:46.205985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.206268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.206547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.207275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] RBAC: Adding query filter params (name=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:46.207586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:46.208942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:46.213645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 497/1011] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:46.219293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:46.223465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:46.318671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 515/1012] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:46.333926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3886e4-f7df-4c7b-b43a-27c85b788184 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:46.379422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b08dd-0c29-420e-a124-eab79ccb7328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:46.380102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b08dd-0c29-420e-a124-eab79ccb7328 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.380446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b08dd-0c29-420e-a124-eab79ccb7328 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.380724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b08dd-0c29-420e-a124-eab79ccb7328 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.381493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b08dd-0c29-420e-a124-eab79ccb7328 None admin] RBAC: Adding query filter params (type=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:46.381808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b08dd-0c29-420e-a124-eab79ccb7328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:46.383295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b08dd-0c29-420e-a124-eab79ccb7328 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:46.398673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 498/1013] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:46.837351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71196e0-b520-447b-818a-6d5d75a3a7af None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.841026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71196e0-b520-447b-818a-6d5d75a3a7af None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.841026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71196e0-b520-447b-818a-6d5d75a3a7af None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.841026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 516/1014] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:46.844470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d3c32-b2f4-4e79-97f8-05f232b37e7a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:46.845407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d3c32-b2f4-4e79-97f8-05f232b37e7a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:46.845739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d3c32-b2f4-4e79-97f8-05f232b37e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:46.863243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a64d3c32-b2f4-4e79-97f8-05f232b37e7a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:46.864433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a64d3c32-b2f4-4e79-97f8-05f232b37e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:46.927541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:46.936399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 499/1015] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:46 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:46.959868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71196e0-b520-447b-818a-6d5d75a3a7af None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:47.066367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71196e0-b520-447b-818a-6d5d75a3a7af None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:47.084344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:47.101969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc28f5-6606-47ea-aafc-b5487e07a650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:47.102715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc28f5-6606-47ea-aafc-b5487e07a650 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:47.103004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc28f5-6606-47ea-aafc-b5487e07a650 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:47.103279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc28f5-6606-47ea-aafc-b5487e07a650 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:47.104524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc28f5-6606-47ea-aafc-b5487e07a650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:47.105954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc28f5-6606-47ea-aafc-b5487e07a650 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:47.112548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 517/1016] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:47.114101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d3c32-b2f4-4e79-97f8-05f232b37e7a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:47.217735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d3c32-b2f4-4e79-97f8-05f232b37e7a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:47.251099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22aed9f-c1f1-4680-bc76-68bb12bf0a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:47.252246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aed9f-c1f1-4680-bc76-68bb12bf0a98 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:47.252532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aed9f-c1f1-4680-bc76-68bb12bf0a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:47.252812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22aed9f-c1f1-4680-bc76-68bb12bf0a98 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:47.253519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22aed9f-c1f1-4680-bc76-68bb12bf0a98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:47.254968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22aed9f-c1f1-4680-bc76-68bb12bf0a98 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:47.346681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 500/1017] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:47 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:12:48.472991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821120a7-2841-4c93-aa7a-13c585b82773 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.473523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821120a7-2841-4c93-aa7a-13c585b82773 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.473523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821120a7-2841-4c93-aa7a-13c585b82773 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.475270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 518/1018] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:48.480726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb38c-e65e-4285-80e1-bb1916a13563 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.481228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb38c-e65e-4285-80e1-bb1916a13563 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.481328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb38c-e65e-4285-80e1-bb1916a13563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.500185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-887fb38c-e65e-4285-80e1-bb1916a13563 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:48.500397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741866b4-d1fb-4070-a368-24a622c174fe None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.500499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741866b4-d1fb-4070-a368-24a622c174fe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.500730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741866b4-d1fb-4070-a368-24a622c174fe None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.501401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-887fb38c-e65e-4285-80e1-bb1916a13563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:48.502907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 519/1019] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:48.509925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee15c-1a5e-4b1a-ac06-f8c09ff41908 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.509925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee15c-1a5e-4b1a-ac06-f8c09ff41908 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.509925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee15c-1a5e-4b1a-ac06-f8c09ff41908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.526471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e75ee15c-1a5e-4b1a-ac06-f8c09ff41908 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:48.527760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e75ee15c-1a5e-4b1a-ac06-f8c09ff41908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:48.552140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:48.579584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 501/1020] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:48.602822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 520/1021] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:48.603745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fb38c-e65e-4285-80e1-bb1916a13563 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:48.622916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ee15c-1a5e-4b1a-ac06-f8c09ff41908 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:48.710148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fb38c-e65e-4285-80e1-bb1916a13563 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:48.735162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ee15c-1a5e-4b1a-ac06-f8c09ff41908 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:48.746128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:48.746980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.747264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.747540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.754101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:48.758494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:48.767660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:48.768611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:48.769466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 502/1022] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Jul 20 15:12:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:48.774797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:48.775654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:48.776320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.776601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.776873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.777715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:48.779240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:48.809338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:48.873889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08da16-35b5-4e44-87a7-55837b0107df None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:48.909369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:48.910039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:48.910369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:48.910669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:48.911421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:48.911731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:48.913098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:48.921177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 503/1023] 10.222.0.87 () {56 vars in 1115 bytes} [Wed Jul 20 15:12:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:48.927403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:48.938682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 521/1024] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:12:48 2022] POST /identity/v3/services => generated 242 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:49.034145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:49.039125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6580e6-7fe5-4a17-acd9-035c628d677e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:49.083807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:49.084616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.084898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.085173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.097631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:49.099954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:49.119713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:49.120682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:49.121594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:49.121594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:49.121594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:49.121594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:49.121594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 504/1025] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:49.128387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:49.232346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8610d15-053b-463f-b883-dda99f614e7c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:49.266050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bcf0b-6fcf-4be6-a042-3ab47196b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:49.266772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcf0b-6fcf-4be6-a042-3ab47196b93d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.267065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcf0b-6fcf-4be6-a042-3ab47196b93d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.267344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcf0b-6fcf-4be6-a042-3ab47196b93d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.268081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcf0b-6fcf-4be6-a042-3ab47196b93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:49.268378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcf0b-6fcf-4be6-a042-3ab47196b93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:49.269744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bcf0b-6fcf-4be6-a042-3ab47196b93d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:49.281813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 522/1026] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:49.288238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:49.390545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840fd87-bb68-4d88-8d80-f4758530b82a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:49.425975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:49.426807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.427092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.427366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.431963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9d2fb-6344-49ee-828b-74e59d62654b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.432255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9d2fb-6344-49ee-828b-74e59d62654b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.432540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9d2fb-6344-49ee-828b-74e59d62654b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.433933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 523/1027] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:49.435122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:49.436569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:49.439736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82f1ff-6ef3-40a3-8a49-0ed428cac230 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.440057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82f1ff-6ef3-40a3-8a49-0ed428cac230 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.440306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82f1ff-6ef3-40a3-8a49-0ed428cac230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:49.453867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:49.460152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:49.461205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 505/1028] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:12:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:49.461893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cd82f1ff-6ef3-40a3-8a49-0ed428cac230 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:49.461893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cd82f1ff-6ef3-40a3-8a49-0ed428cac230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:49.462031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:49.469033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:49.495746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:49.544757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 524/1029] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:49.565795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82f1ff-6ef3-40a3-8a49-0ed428cac230 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:49.574665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77776d7-782e-4481-bbbf-3c31d2aed6ab None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:49.611505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:49.612182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.612604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.612903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.614242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:49.614819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:49.616275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:49.635037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 506/1030] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:12:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:49.640786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:49.673595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82f1ff-6ef3-40a3-8a49-0ed428cac230 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:49.708036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:49.712296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:49.713109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.713383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.728242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.728242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:49.728242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:49.728242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 525/1031] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:49.728242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:49.747807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce13d4-9bb8-421b-8d63-6edfd7dd9562 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:49.759617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:49.785089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:49.785736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.786020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.786301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.826625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfe105-647e-4cc3-b22b-25caff7ad32e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:49.858109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:49.859622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:49.864197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:49.864871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:49.865154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:49.865434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:49.866137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:49.867577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:49.920951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:49.959709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 507/1032] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:12:49.963667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 526/1033] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:12:49 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:49.967899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:50.079907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808a80c-e419-4f17-b884-6ff26eb2f400 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:50.119124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:50.119981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:50.120267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:50.120542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:50.131599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:50.133046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:50.151813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:50.152915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:50.154186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:50.154186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:50.154186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:50.154186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:50.154772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 508/1034] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:50.159570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:50.256765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:50.266332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d48c9-f332-4447-aba0-82715d5fbd91 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:50.301183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:50.301852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:50.302136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:50.302412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:50.303172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:50.303485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:50.304895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:50.316919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 527/1035] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:50.322352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:50.341012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:50.424067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03301ac4-ae47-467c-b37d-dcea8f61737c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:50.457879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:50.458697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:50.458979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:50.459249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:50.465988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:50.467447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:50.481872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:50.483119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:50.484087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:50.486718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 509/1036] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:50.489637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:50.598960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5f861-2704-468e-a3a5-947a65eaed13 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:50.632887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7402346-71bb-4bf3-a1dc-89d513e52032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:50.633548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7402346-71bb-4bf3-a1dc-89d513e52032 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:50.633835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7402346-71bb-4bf3-a1dc-89d513e52032 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:50.634114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7402346-71bb-4bf3-a1dc-89d513e52032 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:50.634930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7402346-71bb-4bf3-a1dc-89d513e52032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:50.635244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7402346-71bb-4bf3-a1dc-89d513e52032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:50.636936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7402346-71bb-4bf3-a1dc-89d513e52032 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:50.654171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 528/1037] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:50.655410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:50.734028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:50.757798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d3c36-1225-47ba-a803-290631cf2db0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:50.792697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6496e2-967b-4789-99c3-b762963bd10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:50.793360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6496e2-967b-4789-99c3-b762963bd10f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:50.793647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6496e2-967b-4789-99c3-b762963bd10f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:50.793924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6496e2-967b-4789-99c3-b762963bd10f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:50.794780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6496e2-967b-4789-99c3-b762963bd10f None admin] RBAC: Adding query filter params (role.id=6381f3b1c4224727bd3b6a2f1aac1cea, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c7816f91ee6e489dbe9642b5bd25a454) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:50.795095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6496e2-967b-4789-99c3-b762963bd10f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:50.796532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6496e2-967b-4789-99c3-b762963bd10f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:50.810667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 510/1038] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:50 2022] GET /identity/v3/role_assignments?user.id=c7816f91ee6e489dbe9642b5bd25a454&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=6381f3b1c4224727bd3b6a2f1aac1cea => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:51.042564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208123a9-0a74-485f-9f07-86252dacc512 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:51.042930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208123a9-0a74-485f-9f07-86252dacc512 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:51.043108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208123a9-0a74-485f-9f07-86252dacc512 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:51.044600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 529/1039] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:51.049633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc3cd-4cd0-46c6-b68b-eccb98cc9bff None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:51.049928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc3cd-4cd0-46c6-b68b-eccb98cc9bff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:51.050209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbc3cd-4cd0-46c6-b68b-eccb98cc9bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:51.067471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0cbbc3cd-4cd0-46c6-b68b-eccb98cc9bff None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:51.068649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0cbbc3cd-4cd0-46c6-b68b-eccb98cc9bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:51.137280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 511/1040] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:51.161224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208123a9-0a74-485f-9f07-86252dacc512 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:51.175419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:51.268880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208123a9-0a74-485f-9f07-86252dacc512 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:51.304486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:51.305199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:51.305483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:51.305759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:51.306409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:51.307810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:51.319530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:51.320592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:51.321470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 530/1041] 10.222.0.87 () {56 vars in 1105 bytes} [Wed Jul 20 15:12:51 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:51.328576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbc3cd-4cd0-46c6-b68b-eccb98cc9bff None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:51.399380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:51.430870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbc3cd-4cd0-46c6-b68b-eccb98cc9bff None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:51.465467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:51.466136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:51.466424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:51.466740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:51.467457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] RBAC: Adding query filter params (name=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:51.467768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:51.469134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:51.479466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 512/1042] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:51.480637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:51.564397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:51.589583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939df55-71f8-4163-8147-2b404962aee8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:51.623823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:51.624550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:51.624771 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:51.625050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:51.625762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] RBAC: Adding query filter params (type=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:51.626099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:51.627497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:51.637595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 531/1043] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:51.638546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:51.738310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4da2e-8ef1-4ad1-8faf-bd524fbe8a3e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:51.772555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61127cbc-69b9-4a2a-aaa9-72416f8388ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:51.773216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127cbc-69b9-4a2a-aaa9-72416f8388ab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:51.773501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127cbc-69b9-4a2a-aaa9-72416f8388ab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:51.773780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127cbc-69b9-4a2a-aaa9-72416f8388ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:51.774573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127cbc-69b9-4a2a-aaa9-72416f8388ab None admin] RBAC: Adding query filter params (interface=public, service_id=c0131017722448ee86eed60935690d39, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:51.774916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127cbc-69b9-4a2a-aaa9-72416f8388ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:51.776288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127cbc-69b9-4a2a-aaa9-72416f8388ab None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:51.777819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:51.783184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 513/1044] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:12:51 2022] GET /identity/v3/endpoints?service_id=c0131017722448ee86eed60935690d39&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:51.788662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:51.892465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd37d15-acea-479d-84c8-e4af35330448 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:51.927775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08fce2-b73b-49f7-89eb-0175e32b6b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:51.928443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fce2-b73b-49f7-89eb-0175e32b6b71 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:51.928728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fce2-b73b-49f7-89eb-0175e32b6b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:51.929006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fce2-b73b-49f7-89eb-0175e32b6b71 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:51.929692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08fce2-b73b-49f7-89eb-0175e32b6b71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:51.931084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08fce2-b73b-49f7-89eb-0175e32b6b71 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:51.942702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 532/1045] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:12:51 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:12:52.110603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231fce8-8d2f-469a-87bc-7e26ad40fa6b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.111103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231fce8-8d2f-469a-87bc-7e26ad40fa6b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.111425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231fce8-8d2f-469a-87bc-7e26ad40fa6b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.113107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 514/1046] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:52.118456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3182f-1029-4d3f-83ed-dfeaf5195b93 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.118785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3182f-1029-4d3f-83ed-dfeaf5195b93 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.119065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3182f-1029-4d3f-83ed-dfeaf5195b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.124039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:52.137422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-43f3182f-1029-4d3f-83ed-dfeaf5195b93 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:52.138585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-43f3182f-1029-4d3f-83ed-dfeaf5195b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:52.206968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 533/1047] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:52.229821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231fce8-8d2f-469a-87bc-7e26ad40fa6b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:52.335053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231fce8-8d2f-469a-87bc-7e26ad40fa6b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:52.369134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:52.369927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.370211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.370488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.381759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:52.389627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:52.390582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:52.391956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:52.394829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 515/1048] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:52.397394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3182f-1029-4d3f-83ed-dfeaf5195b93 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:52.503681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3182f-1029-4d3f-83ed-dfeaf5195b93 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:52.537175 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:52.542185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:52.542883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.543171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.543446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.544190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:52.544498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:52.545860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:52.559528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 534/1049] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:52.560482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:52.623043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:52.665404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4178a9-27f3-4803-8b26-85449c488b54 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:52.700261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24bb2-3116-40a2-978d-f4c0ca983864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:52.701142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24bb2-3116-40a2-978d-f4c0ca983864 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.701423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24bb2-3116-40a2-978d-f4c0ca983864 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.701699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24bb2-3116-40a2-978d-f4c0ca983864 None admin] PATH_INFO: `/v3/users/cbac4ec5615e44bb948ae04103cb4745` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.715190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f24bb2-3116-40a2-978d-f4c0ca983864 None admin] RBAC: Authorizing `identity:get_user(user_id=cbac4ec5615e44bb948ae04103cb4745)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:52.716625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f24bb2-3116-40a2-978d-f4c0ca983864 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:52.723745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 516/1050] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:12:52 2022] GET /identity/v3/users/cbac4ec5615e44bb948ae04103cb4745 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:52.724747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:52.829780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fca1c-fdf6-4ec1-b456-e075a706104c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:52.833935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfbf6-9ea8-461d-9aa3-612ee56c1ba6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.834388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfbf6-9ea8-461d-9aa3-612ee56c1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.834636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfbf6-9ea8-461d-9aa3-612ee56c1ba6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.836145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 517/1051] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:52.840882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3c8-d537-4497-b4ff-72c755ff8718 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.841175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3c8-d537-4497-b4ff-72c755ff8718 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.841488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3c8-d537-4497-b4ff-72c755ff8718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.858906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a4dbc3c8-d537-4497-b4ff-72c755ff8718 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:52.860103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a4dbc3c8-d537-4497-b4ff-72c755ff8718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:52.866926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:52.867580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:52.867936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:52.868150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:52.931055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:52.932463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 518/1052] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:52.941074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:52.942708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:52.955567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc3c8-d537-4497-b4ff-72c755ff8718 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.005821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:53.052906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 535/1053] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:12:53.063323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.075790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc3c8-d537-4497-b4ff-72c755ff8718 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.112358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.113191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.113480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.113736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:53.126367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:53.137238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:53.138176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:53.139614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 519/1054] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Jul 20 15:12:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:53.144784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.163055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:53.171305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678476-ca5f-4604-856f-5fa1ceb5ac72 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.210040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.210942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.211239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.211538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:53.212686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] RBAC: Authorizing `identity:get_project(project_id=dc22cd2394ff467bb8b26c1131990a4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:53.214150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:53.215898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 536/1055] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:12:53 2022] GET /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:53.222421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.254418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44465631-1299-45ae-b94c-f6d1d84e8931 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.261656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:53.289979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.290660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.290958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.291240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:53.291991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:53.292301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:53.293702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:53.303406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 520/1056] 10.222.0.87 () {56 vars in 1115 bytes} [Wed Jul 20 15:12:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:53.308785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.333428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e5fd-c8e7-4330-93c9-9bb093349481 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.371682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.372262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.372550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.372831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:53.373663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=dc22cd2394ff467bb8b26c1131990a4b, user.id=cbac4ec5615e44bb948ae04103cb4745) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:53.373984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:53.375471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:53.390679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 537/1057] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:53 2022] GET /identity/v3/role_assignments?user.id=cbac4ec5615e44bb948ae04103cb4745&scope.project.id=dc22cd2394ff467bb8b26c1131990a4b&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:53.440066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1165ce3-6884-4caf-a54d-dfc690c69d4a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.477509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.478322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.478610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.478919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:53.490718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:53.492213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:53.513398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:53.514300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:53.515259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:53.515259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:53.515259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:53.515259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:53.519010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 521/1058] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:53.521257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.551525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:53.624646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5718-b780-4b81-b6bc-2c7d2b60a2da None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.662940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.663609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.663897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.664174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:53.664903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:53.665210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:53.666580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:53.682937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 538/1059] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:53.684208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.708493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:53.789561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed0a9-360e-45c2-a780-255364a015d1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.825080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066e836-ad71-42c1-b047-42d5f46c2ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.825877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066e836-ad71-42c1-b047-42d5f46c2ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.826164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066e836-ad71-42c1-b047-42d5f46c2ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.826441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066e836-ad71-42c1-b047-42d5f46c2ae5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:53.835724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066e836-ad71-42c1-b047-42d5f46c2ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:53.837215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066e836-ad71-42c1-b047-42d5f46c2ae5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1066e836-ad71-42c1-b047-42d5f46c2ae5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:53.852751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:53.853749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:53.858139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 522/1060] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:12:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:53.862133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:53.948373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:53.963490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceecde-3480-4b96-be17-7dd9cb6d5a9f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:53.998317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:53.999031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:53.999317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:53.999597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.000446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:54.000763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.002993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.004424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36094b-fb27-46e2-9ae6-5b5ffdeb5d8a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.004716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36094b-fb27-46e2-9ae6-5b5ffdeb5d8a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.004999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36094b-fb27-46e2-9ae6-5b5ffdeb5d8a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.006530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 523/1061] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:54.011792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf41dc-5fc2-4427-a568-a77f07f70b85 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.012080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf41dc-5fc2-4427-a568-a77f07f70b85 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.012361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf41dc-5fc2-4427-a568-a77f07f70b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.028911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 539/1062] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:12:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:54.029551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-82bf41dc-5fc2-4427-a568-a77f07f70b85 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:54.030199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.030778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82bf41dc-5fc2-4427-a568-a77f07f70b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:54.103239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 524/1063] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:54.127485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf41dc-5fc2-4427-a568-a77f07f70b85 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.136776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3de9-6520-4782-a869-11fa769bd878 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.138943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:54.171488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.172277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.172565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.173471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.184001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.185449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.187970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:54.204284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:54.205212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:54.206120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:54.206120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:54.206120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:54.206120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:54.210229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 540/1064] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:54.211101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.234564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf41dc-5fc2-4427-a568-a77f07f70b85 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.274363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.275181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.275468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.275746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.276400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.277773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:54.290096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:54.291380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 15:12:54.292419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:54.293667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 525/1065] 10.222.0.87 () {56 vars in 1105 bytes} [Wed Jul 20 15:12:54 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:54.300386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.319990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e5c0-937c-4bca-8175-3169360630e5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.356099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.356859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.357215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.357566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.358370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:54.358808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.360291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.373461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 541/1066] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:54.378804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.379886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:54.404205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214829-06bc-4207-9757-db8f743d61b7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.436628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:54.442001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.442788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.443146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.443552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.444338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] RBAC: Adding query filter params (name=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:54.444655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.446038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.452068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 526/1067] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:54.457822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.491220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f617f62-ddd4-44b9-a73f-88df5b6850ca None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.534010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.536476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.536476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.536476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.543733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.545180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:54.560416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:54.561353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:54.562258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 542/1068] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:54.567465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.577865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054adfc-3afe-4d47-a0de-69d60b441f5d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.614927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.615738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.616025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.616306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.617029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] RBAC: Adding query filter params (type=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:54.617338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.618726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.624867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 527/1069] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:54.631398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.634446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:54.680722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654bce-8480-46bc-b8ee-c209c8d789c2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.696606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:54.715097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.715693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.715982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.716263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.717069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:54.717385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.718840 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.731689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 543/1070] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:54.737790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:54.745953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cd517-82c4-44cc-8583-bde58d6def60 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.793561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebafb8-9c42-44da-b37c-2e2b6a91e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.794226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebafb8-9c42-44da-b37c-2e2b6a91e416 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.794941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebafb8-9c42-44da-b37c-2e2b6a91e416 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.795249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebafb8-9c42-44da-b37c-2e2b6a91e416 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.796072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebafb8-9c42-44da-b37c-2e2b6a91e416 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.797413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebafb8-9c42-44da-b37c-2e2b6a91e416 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.842776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780237a0-523f-4ca7-924b-eec98746dd82 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:54.882679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 528/1071] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:12:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:12:54.897124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f54dfe-e72a-49dc-8334-1c0c80b9997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:54.898038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54dfe-e72a-49dc-8334-1c0c80b9997f None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:54.898330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54dfe-e72a-49dc-8334-1c0c80b9997f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:54.898608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f54dfe-e72a-49dc-8334-1c0c80b9997f None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c7816f91ee6e489dbe9642b5bd25a454/roles/6381f3b1c4224727bd3b6a2f1aac1cea` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:54.901009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f54dfe-e72a-49dc-8334-1c0c80b9997f None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=c7816f91ee6e489dbe9642b5bd25a454, role_id=6381f3b1c4224727bd3b6a2f1aac1cea)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:54.902500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f54dfe-e72a-49dc-8334-1c0c80b9997f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:54.986931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 544/1072] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:54 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c7816f91ee6e489dbe9642b5bd25a454/roles/6381f3b1c4224727bd3b6a2f1aac1cea => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:12:55.472407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06ddf-6024-4691-a9dc-b68ace7268cd None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:55.472791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06ddf-6024-4691-a9dc-b68ace7268cd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:55.472995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06ddf-6024-4691-a9dc-b68ace7268cd None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:55.474499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 529/1073] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:55.479505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a3fc-2ad3-4140-b661-f499dea1014e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:55.479798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a3fc-2ad3-4140-b661-f499dea1014e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:55.480096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418a3fc-2ad3-4140-b661-f499dea1014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:55.499810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7418a3fc-2ad3-4140-b661-f499dea1014e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:55.501778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7418a3fc-2ad3-4140-b661-f499dea1014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:55.529741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:55.573314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 545/1074] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:55.596399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e06ddf-6024-4691-a9dc-b68ace7268cd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:55.659346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:55.708446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e06ddf-6024-4691-a9dc-b68ace7268cd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:55.744818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:55.745527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:55.745805 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:55.746079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:55.756505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:55.764272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:55.765195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:55.766040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:55.770717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 530/1075] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:55.772105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a3fc-2ad3-4140-b661-f499dea1014e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:55.872161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418a3fc-2ad3-4140-b661-f499dea1014e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:55.906105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:55.906864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:55.907601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:55.908073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:55.908886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:55.909196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:55.910549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:55.924229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 546/1076] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:55.925667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:56.028579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2aa34-c314-4921-b820-bcb51aef6cc4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:56.046747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:56.066544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:56.067466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:56.067749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:56.068024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] PATH_INFO: `/v3/users/cbac4ec5615e44bb948ae04103cb4745` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:56.069215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] RBAC: Authorizing `identity:get_user(user_id=cbac4ec5615e44bb948ae04103cb4745)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:56.070738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:56.077351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 531/1077] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:12:55 2022] GET /identity/v3/users/cbac4ec5615e44bb948ae04103cb4745 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:56.078217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:56.107544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:56.183869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c72f25-b223-4523-94d6-cdc53ed12ca6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:56.218058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4920ed1-e5f4-4b64-b8a2-a82e2a94ac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:56.218940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920ed1-e5f4-4b64-b8a2-a82e2a94ac77 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:56.219276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920ed1-e5f4-4b64-b8a2-a82e2a94ac77 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:56.219572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920ed1-e5f4-4b64-b8a2-a82e2a94ac77 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:56.221692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4920ed1-e5f4-4b64-b8a2-a82e2a94ac77 None admin] RBAC: Authorizing `identity:get_project(project_id=dc22cd2394ff467bb8b26c1131990a4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:56.223150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4920ed1-e5f4-4b64-b8a2-a82e2a94ac77 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:56.224990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 547/1078] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:12:56 2022] GET /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:56.230802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:56.331326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301d6cf-f318-4ec7-b790-ab173120bdd8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:56.364891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10788439-e394-4931-802e-67e4f82fdc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:56.365776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10788439-e394-4931-802e-67e4f82fdc59 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:56.366051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10788439-e394-4931-802e-67e4f82fdc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:56.366318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10788439-e394-4931-802e-67e4f82fdc59 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b/users/cbac4ec5615e44bb948ae04103cb4745/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:56.368284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10788439-e394-4931-802e-67e4f82fdc59 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc22cd2394ff467bb8b26c1131990a4b, user_id=cbac4ec5615e44bb948ae04103cb4745, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:56.369702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10788439-e394-4931-802e-67e4f82fdc59 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:56.444051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 532/1079] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:12:56 2022] PUT /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b/users/cbac4ec5615e44bb948ae04103cb4745/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:12:56.948249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca593-9971-4774-948f-50e7c6be70f4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:56.948832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca593-9971-4774-948f-50e7c6be70f4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:56.948832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ca593-9971-4774-948f-50e7c6be70f4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:56.950315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 548/1080] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:12:56.956063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741e09-a82f-4253-8c29-e40d2ab46129 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:56.956463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741e09-a82f-4253-8c29-e40d2ab46129 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:56.956655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09741e09-a82f-4253-8c29-e40d2ab46129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:56.973715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-09741e09-a82f-4253-8c29-e40d2ab46129 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:56.974925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-09741e09-a82f-4253-8c29-e40d2ab46129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:57.017300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:57.033576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a5c0-3786-49fe-98d2-76043ac20416 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.033879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a5c0-3786-49fe-98d2-76043ac20416 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.034168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a5c0-3786-49fe-98d2-76043ac20416 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.035896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 549/1081] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:57.040562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5992a-d231-4f94-a4e0-31615c9d3c39 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.040848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5992a-d231-4f94-a4e0-31615c9d3c39 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.041198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5992a-d231-4f94-a4e0-31615c9d3c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.042537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 533/1082] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:12:57.058140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-39b5992a-d231-4f94-a4e0-31615c9d3c39 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:57.059345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-39b5992a-d231-4f94-a4e0-31615c9d3c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:57.064660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09741e09-a82f-4253-8c29-e40d2ab46129 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.130706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 550/1083] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:57.152940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5992a-d231-4f94-a4e0-31615c9d3c39 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.170405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09741e09-a82f-4253-8c29-e40d2ab46129 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:57.177358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:57.206730 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:57.207384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.207671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.207957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.256867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:57.260139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5992a-d231-4f94-a4e0-31615c9d3c39 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:57.279051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:57.280514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:57.296301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:57.297383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.298530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.298845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.309513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:57.317538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:57.318477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:57.319399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 551/1084] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:57.324766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.402502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 534/1085] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:12:57.408771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.410416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:57.429077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc97a5-0bd5-45af-92f5-a0a1f58cee29 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:57.465118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:57.465713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.465996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.466273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.467069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:57.467379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:57.468748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:57.482689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 552/1086] 10.222.0.87 () {56 vars in 1115 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:57.483882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.503007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:57.530289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fdace-ef97-4c4c-a407-6a06885d4dd4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:57.567505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:57.568324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.568608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.568882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.580718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:57.582210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:57.600389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b1034-122f-47e6-87de-e5fb8dee348e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:57.600660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:57.601713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:57.602704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:57.602704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:57.602704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:57.602704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:57.602704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 535/1087] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:57.607525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.643140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:57.644187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.644478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.644758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.655692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:57.657716 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:57.661031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:57.676654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:57.677668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:57.678576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:57.678576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:57.678576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:57.678576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:57.678576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 553/1088] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:57.683524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.720573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b641c7-724f-4f19-8c16-cb645fa39eab None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:57.749740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:57.758634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:57.761277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.761277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.761277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.761277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:57.761277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:57.762772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:57.782667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 536/1089] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:57.795324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69218d72-3ad6-4047-92c6-fe629047e79f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:57.835192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:57.835882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:57.836166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:57.836441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:57.837201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:57.837487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:57.838891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:57.852899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 554/1090] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:57.858631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:57.969407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b17ac-b8d5-45df-b2cc-e048569b639d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.006626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.007393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.007683 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.007953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.016769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:58.018321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:12:58.033452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:58.034440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:58.035512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 537/1091] 10.222.0.87 () {56 vars in 1093 bytes} [Wed Jul 20 15:12:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:58.040505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.098255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:58.141834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff78bb-7ccc-412c-b51b-83d942f45e05 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.175941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236559a-f938-4cfa-9f76-be022095f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.176604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236559a-f938-4cfa-9f76-be022095f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.176889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236559a-f938-4cfa-9f76-be022095f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.177165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236559a-f938-4cfa-9f76-be022095f4c2 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.177994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236559a-f938-4cfa-9f76-be022095f4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:58.178304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236559a-f938-4cfa-9f76-be022095f4c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:58.179763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236559a-f938-4cfa-9f76-be022095f4c2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:58.197094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 555/1092] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:58.202881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.251471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:58.302232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fb218-c52f-4691-9b55-2eedeb5af11b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.334780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.335423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.335706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.335980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.402419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:58.403900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:58.458203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:58.510687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 538/1093] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:12:58.516515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.517185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a40548-c46d-4c2d-ad0f-7a8b0d198680 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.517478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a40548-c46d-4c2d-ad0f-7a8b0d198680 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.517763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a40548-c46d-4c2d-ad0f-7a8b0d198680 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.519180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 556/1094] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:12:58.525161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218d46-c91e-4dd0-a6de-8dd577903212 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.525446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218d46-c91e-4dd0-a6de-8dd577903212 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.525725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218d46-c91e-4dd0-a6de-8dd577903212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.542504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d6218d46-c91e-4dd0-a6de-8dd577903212 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:12:58.543717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d6218d46-c91e-4dd0-a6de-8dd577903212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:12:58.612725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 557/1095] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:12:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:12:58.615796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df2247-199d-45b9-82c8-c3f44b9992a6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.636837 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218d46-c91e-4dd0-a6de-8dd577903212 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.650789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.651582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.651867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.652145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.662074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:58.663542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:58.671745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:58.681438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:12:58.681668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:58.682554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:58.683597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:12:58.683597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:12:58.683597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:12:58.683597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:58.683597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 539/1096] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:12:58.689104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.739385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218d46-c91e-4dd0-a6de-8dd577903212 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.772704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.773492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.773775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.774048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.785148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:12:58.789665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faab932-6ff3-4959-8616-d2b1dd5a3eba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:12:58.792784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:58.793889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:12:58.794779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 558/1097] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:58.800565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.824858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.825515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.825796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.826076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.826825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:58.827195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:58.828542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:58.840260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 540/1098] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:58.846291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.907642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:58.919822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cfc5b-4cbc-4e4d-91db-0d112684dc15 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.922135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:58.948043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163a44e-734d-49ad-84b2-7d7854970b6b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:58.953018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.953686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.954016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.954291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.955100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:58.955417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:58.957106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:58.965696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 559/1099] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:58.972556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:58.981994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:58.982824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:58.983118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:58.983401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:58.990800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:58.992249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:12:59.006248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:12:59.007244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:12:59.008431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 541/1100] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:12:59.013602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:59.073868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a84b1-7eb0-4811-ad9d-91a8fabc50dc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:59.107769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:59.108640 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:59.108920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:59.109194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] PATH_INFO: `/v3/users/cbac4ec5615e44bb948ae04103cb4745` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:59.110434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] RBAC: Authorizing `identity:get_user(user_id=cbac4ec5615e44bb948ae04103cb4745)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:59.112015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:59.113286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db770-06f1-478e-919e-e7fd64e0e370 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:59.113652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 560/1101] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:12:58 2022] GET /identity/v3/users/cbac4ec5615e44bb948ae04103cb4745 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:59.119287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:59.138817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:59.153314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:59.153498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:59.153970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:59.154257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:59.154537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:59.155358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:59.155673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:59.158300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:59.169968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 542/1102] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:59.177162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:59.220506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7fbba-ea5b-4ac2-9732-3802cf531b1a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:59.254387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:59.255096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:59.255384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:59.255664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:59.275920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f147-bf62-4890-9e5c-c55489330465 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:59.308353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:59.308994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:59.309303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:59.309580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:59.310404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] RBAC: Adding query filter params (role.id=6381f3b1c4224727bd3b6a2f1aac1cea, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c7816f91ee6e489dbe9642b5bd25a454) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:59.310750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:59.312193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:59.318594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 543/1103] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:59 2022] GET /identity/v3/role_assignments?user.id=c7816f91ee6e489dbe9642b5bd25a454&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=6381f3b1c4224727bd3b6a2f1aac1cea => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:12:59.323277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:59.324754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:59.361016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:59.433263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 561/1104] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:12:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 15:12:59.439917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:59.488526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:59.545107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2976d-2dcb-4702-a59f-73888d87445f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:59.580448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e033368-ec15-48c6-89e9-030f7b85f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:59.581323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e033368-ec15-48c6-89e9-030f7b85f405 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:59.581613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e033368-ec15-48c6-89e9-030f7b85f405 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:59.581892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e033368-ec15-48c6-89e9-030f7b85f405 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:59.583107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e033368-ec15-48c6-89e9-030f7b85f405 None admin] RBAC: Authorizing `identity:get_project(project_id=dc22cd2394ff467bb8b26c1131990a4b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:59.584541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e033368-ec15-48c6-89e9-030f7b85f405 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:59.586288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 544/1105] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:12:59 2022] GET /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:12:59.592420 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:12:59.694974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e7111-7a5d-4fb3-afcd-9993a4b707e8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:12:59.730503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde3574-aef3-4f01-a778-7b2fbc00cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:12:59.731211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde3574-aef3-4f01-a778-7b2fbc00cb6b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:12:59.731497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde3574-aef3-4f01-a778-7b2fbc00cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:12:59.731778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde3574-aef3-4f01-a778-7b2fbc00cb6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:12:59.732616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde3574-aef3-4f01-a778-7b2fbc00cb6b None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=dc22cd2394ff467bb8b26c1131990a4b, user.id=cbac4ec5615e44bb948ae04103cb4745) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:12:59.732938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde3574-aef3-4f01-a778-7b2fbc00cb6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:12:59.734377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde3574-aef3-4f01-a778-7b2fbc00cb6b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:12:59.736885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:12:59.743389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 562/1106] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:12:59 2022] GET /identity/v3/role_assignments?user.id=cbac4ec5615e44bb948ae04103cb4745&scope.project.id=dc22cd2394ff467bb8b26c1131990a4b&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:01.826910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082bff9-c903-4a52-bcb6-57dd7b8f9a38 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:01.827428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082bff9-c903-4a52-bcb6-57dd7b8f9a38 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:01.827428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082bff9-c903-4a52-bcb6-57dd7b8f9a38 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:01.828759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 545/1107] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:01.834418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d6821-e219-4f84-9b3f-532b09c8e637 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:01.834883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d6821-e219-4f84-9b3f-532b09c8e637 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:01.835007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d6821-e219-4f84-9b3f-532b09c8e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:01.851802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-432d6821-e219-4f84-9b3f-532b09c8e637 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:01.852975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-432d6821-e219-4f84-9b3f-532b09c8e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:01.917612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 563/1108] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:01.942535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082bff9-c903-4a52-bcb6-57dd7b8f9a38 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:02.041534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082bff9-c903-4a52-bcb6-57dd7b8f9a38 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:02.054914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:02.074892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7a995-5f2b-44bd-953d-aa33accd128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:02.075670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a995-5f2b-44bd-953d-aa33accd128f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:02.078266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a995-5f2b-44bd-953d-aa33accd128f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:02.078266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7a995-5f2b-44bd-953d-aa33accd128f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:02.078266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7a995-5f2b-44bd-953d-aa33accd128f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:02.079352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7a995-5f2b-44bd-953d-aa33accd128f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:02.081026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 546/1109] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:02.086702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d6821-e219-4f84-9b3f-532b09c8e637 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:02.182477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d6821-e219-4f84-9b3f-532b09c8e637 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:02.208629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:02.216036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9d1be-980e-42c3-bf66-961c6caa26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:02.221309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d1be-980e-42c3-bf66-961c6caa26b6 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:02.221309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d1be-980e-42c3-bf66-961c6caa26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:02.221309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9d1be-980e-42c3-bf66-961c6caa26b6 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:02.221309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9d1be-980e-42c3-bf66-961c6caa26b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:02.221309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9d1be-980e-42c3-bf66-961c6caa26b6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:02.282812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 564/1110] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:13:02 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:13:04.356481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d90b-57d2-4686-8d0a-43ea12ef6e74 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:04.356998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d90b-57d2-4686-8d0a-43ea12ef6e74 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:04.357090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8d90b-57d2-4686-8d0a-43ea12ef6e74 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:04.358405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 547/1111] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:04.364314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1beb3-b134-4e41-af14-0f29c58c9a48 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:04.364761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1beb3-b134-4e41-af14-0f29c58c9a48 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:04.364857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1beb3-b134-4e41-af14-0f29c58c9a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:04.382101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a5a1beb3-b134-4e41-af14-0f29c58c9a48 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:04.383300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a5a1beb3-b134-4e41-af14-0f29c58c9a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:04.447896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 565/1112] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:04.470759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d90b-57d2-4686-8d0a-43ea12ef6e74 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:04.572773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8d90b-57d2-4686-8d0a-43ea12ef6e74 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:04.604942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:04.605784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:04.606072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:04.606352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] PATH_INFO: `/v3/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:04.607906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] RBAC: Authorizing `identity:get_role(role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:04.609223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:04.611330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 548/1113] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:04 2022] GET /identity/v3/roles/1a4d2011cce6457b9a1d4462800949db => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:04.617197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1beb3-b134-4e41-af14-0f29c58c9a48 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:04.713523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1beb3-b134-4e41-af14-0f29c58c9a48 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:04.728275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:04.748051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:04.748916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:04.749199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:04.749476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] PATH_INFO: `/v3/users/a56e7752be10425b94aa5f95efba693f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:04.762686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] RBAC: Authorizing `identity:get_user(user_id=a56e7752be10425b94aa5f95efba693f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:04.764128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:04.765761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 566/1114] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:04 2022] GET /identity/v3/users/a56e7752be10425b94aa5f95efba693f => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:04.771567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:04.820740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:04.870486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18a28f-09d5-4482-8183-d5ee2a5acb35 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:04.904669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:04.905311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:04.905595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:04.905876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:04.972067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:04.973511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:05.019279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:05.069711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 549/1115] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:13:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:13:05.075650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:05.171190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69afa2-1346-4793-817c-c0933cf4532e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:05.203033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79b087-0aaf-4887-89df-d8d645224333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:05.204396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b087-0aaf-4887-89df-d8d645224333 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:05.204682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b087-0aaf-4887-89df-d8d645224333 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:05.204958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79b087-0aaf-4887-89df-d8d645224333 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:05.206128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79b087-0aaf-4887-89df-d8d645224333 None admin] RBAC: Authorizing `identity:get_project(project_id=dc22cd2394ff467bb8b26c1131990a4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:05.207578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79b087-0aaf-4887-89df-d8d645224333 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:05.209251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 567/1116] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:05 2022] GET /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:05.215284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:05.311631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83f40-a32c-4054-aab0-2c588ee97674 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:05.345088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b942e5e-9500-4d0a-b970-762a789acaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:05.345715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942e5e-9500-4d0a-b970-762a789acaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:05.346001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942e5e-9500-4d0a-b970-762a789acaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:05.346277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942e5e-9500-4d0a-b970-762a789acaa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:05.347127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b942e5e-9500-4d0a-b970-762a789acaa5 None admin] RBAC: Adding query filter params (role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=dc22cd2394ff467bb8b26c1131990a4b, user.id=a56e7752be10425b94aa5f95efba693f) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:05.347441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b942e5e-9500-4d0a-b970-762a789acaa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:05.348868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b942e5e-9500-4d0a-b970-762a789acaa5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:05.354178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 550/1117] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:13:05 2022] GET /identity/v3/role_assignments?user.id=a56e7752be10425b94aa5f95efba693f&scope.project.id=dc22cd2394ff467bb8b26c1131990a4b&role.id=1a4d2011cce6457b9a1d4462800949db => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:07.389432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32734f-ff1a-407d-993e-5be14cd1e066 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:07.390014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32734f-ff1a-407d-993e-5be14cd1e066 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:07.390014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32734f-ff1a-407d-993e-5be14cd1e066 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:07.391915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 568/1118] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:07.397285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27d748-6d8e-448e-9e8d-4613e37e1d04 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:07.397700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27d748-6d8e-448e-9e8d-4613e37e1d04 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:07.397844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27d748-6d8e-448e-9e8d-4613e37e1d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:07.414818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1b27d748-6d8e-448e-9e8d-4613e37e1d04 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:07.415990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1b27d748-6d8e-448e-9e8d-4613e37e1d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:07.423196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:07.480051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 551/1119] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:07.502587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32734f-ff1a-407d-993e-5be14cd1e066 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:07.545720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:07.603076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32734f-ff1a-407d-993e-5be14cd1e066 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:07.635769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:07.636870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:07.637151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:07.637424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] PATH_INFO: `/v3/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:07.638896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] RBAC: Authorizing `identity:get_role(role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:07.640296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:07.642531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 569/1120] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:07 2022] GET /identity/v3/roles/1a4d2011cce6457b9a1d4462800949db => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:07.648347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27d748-6d8e-448e-9e8d-4613e37e1d04 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:07.745096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27d748-6d8e-448e-9e8d-4613e37e1d04 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:07.778942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:07.779800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:07.780079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:07.780352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] PATH_INFO: `/v3/users/a56e7752be10425b94aa5f95efba693f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:07.781515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a56e7752be10425b94aa5f95efba693f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:07.783443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:07.785039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 552/1121] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:07 2022] GET /identity/v3/users/a56e7752be10425b94aa5f95efba693f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:07.790576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:07.887193 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dfcbf-0745-4a86-a413-6dc2bf787b21 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:07.897213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:07.920466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18154f-b2be-4ad2-8147-172e4cf691c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:07.921312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18154f-b2be-4ad2-8147-172e4cf691c1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:07.921784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18154f-b2be-4ad2-8147-172e4cf691c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:07.922268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18154f-b2be-4ad2-8147-172e4cf691c1 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:07.924091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18154f-b2be-4ad2-8147-172e4cf691c1 None admin] RBAC: Authorizing `identity:get_project(project_id=dc22cd2394ff467bb8b26c1131990a4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:07.925545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18154f-b2be-4ad2-8147-172e4cf691c1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:07.927253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 570/1122] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:07 2022] GET /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:07.933439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:07.946117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:08.031382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044b2f8-9d92-4750-97b1-2f90ae8d33e7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:08.065599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea949c-a85c-4022-bc77-55dc20740a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:08.066467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea949c-a85c-4022-bc77-55dc20740a09 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:08.066776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea949c-a85c-4022-bc77-55dc20740a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:08.067051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea949c-a85c-4022-bc77-55dc20740a09 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b/users/a56e7752be10425b94aa5f95efba693f/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:08.069205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea949c-a85c-4022-bc77-55dc20740a09 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc22cd2394ff467bb8b26c1131990a4b, user_id=a56e7752be10425b94aa5f95efba693f, role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:08.070608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea949c-a85c-4022-bc77-55dc20740a09 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:08.116593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 553/1123] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:13:07 2022] PUT /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b/users/a56e7752be10425b94aa5f95efba693f/roles/1a4d2011cce6457b9a1d4462800949db => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:13:10.133453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167b0f-91b4-4b47-874b-e3037864dd0f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:10.134022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167b0f-91b4-4b47-874b-e3037864dd0f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:10.134022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12167b0f-91b4-4b47-874b-e3037864dd0f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:10.135408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 571/1124] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:10.140919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57187-a5b6-405a-91e8-f2580cea31fe None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:10.141883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57187-a5b6-405a-91e8-f2580cea31fe None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:10.142083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57187-a5b6-405a-91e8-f2580cea31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:10.158385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2cc57187-a5b6-405a-91e8-f2580cea31fe None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:10.159593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2cc57187-a5b6-405a-91e8-f2580cea31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:10.219978 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:10.224642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 554/1125] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:10.248049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12167b0f-91b4-4b47-874b-e3037864dd0f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:10.347009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12167b0f-91b4-4b47-874b-e3037864dd0f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:10.380115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:10.380957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:10.381240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:10.381512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] PATH_INFO: `/v3/roles/1a4d2011cce6457b9a1d4462800949db` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:10.383003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] RBAC: Authorizing `identity:get_role(role_id=1a4d2011cce6457b9a1d4462800949db)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:10.384415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:10.385714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 572/1126] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:10 2022] GET /identity/v3/roles/1a4d2011cce6457b9a1d4462800949db => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:10.391638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57187-a5b6-405a-91e8-f2580cea31fe None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:10.487392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57187-a5b6-405a-91e8-f2580cea31fe None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:10.521446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:10.522309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:10.522592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:10.522899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] PATH_INFO: `/v3/users/a56e7752be10425b94aa5f95efba693f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:10.524079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] RBAC: Authorizing `identity:get_user(user_id=a56e7752be10425b94aa5f95efba693f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:10.525520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:10.527187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 555/1127] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:10 2022] GET /identity/v3/users/a56e7752be10425b94aa5f95efba693f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:10.533244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:10.578789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:10.631594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7a9ce-4475-491f-b3fc-5a71bd9071a3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:10.665201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:10.665781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:10.666065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:10.666339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:10.732740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:10.734172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:10.776698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:10.830652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 573/1128] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:13:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:13:10.836600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:10.905408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:10.939340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1f391-2fe2-4b56-a403-e38803ecf7c6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:10.972454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbf8d-e2ed-4074-8881-24d6ed770695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:10.973302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbf8d-e2ed-4074-8881-24d6ed770695 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:10.973588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbf8d-e2ed-4074-8881-24d6ed770695 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:10.973866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbf8d-e2ed-4074-8881-24d6ed770695 None admin] PATH_INFO: `/v3/projects/dc22cd2394ff467bb8b26c1131990a4b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:10.975065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbf8d-e2ed-4074-8881-24d6ed770695 None admin] RBAC: Authorizing `identity:get_project(project_id=dc22cd2394ff467bb8b26c1131990a4b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:10.976491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbf8d-e2ed-4074-8881-24d6ed770695 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:10.978190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 556/1129] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:10 2022] GET /identity/v3/projects/dc22cd2394ff467bb8b26c1131990a4b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:10.984438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:11.081389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83f24b-bcdd-4ca6-94c0-7f2ccc4ef7ff None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:11.114083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d4042-4894-40fe-b6f7-687609cf7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:11.114745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4042-4894-40fe-b6f7-687609cf7c96 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:11.115030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4042-4894-40fe-b6f7-687609cf7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:11.115302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4042-4894-40fe-b6f7-687609cf7c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:11.116117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d4042-4894-40fe-b6f7-687609cf7c96 None admin] RBAC: Adding query filter params (role.id=1a4d2011cce6457b9a1d4462800949db, scope.project.id=dc22cd2394ff467bb8b26c1131990a4b, user.id=a56e7752be10425b94aa5f95efba693f) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:11.116426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d4042-4894-40fe-b6f7-687609cf7c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:11.117827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d4042-4894-40fe-b6f7-687609cf7c96 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:11.123429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 574/1130] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:13:10 2022] GET /identity/v3/role_assignments?user.id=a56e7752be10425b94aa5f95efba693f&scope.project.id=dc22cd2394ff467bb8b26c1131990a4b&role.id=1a4d2011cce6457b9a1d4462800949db => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:13.171159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ade81-eb87-43c7-b3d2-9905b3c81cd9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:13.171718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ade81-eb87-43c7-b3d2-9905b3c81cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:13.171718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ade81-eb87-43c7-b3d2-9905b3c81cd9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:13.173421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 557/1131] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:13.178660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb59aed-f539-42ad-a604-97c13b9f5efc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:13.179054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb59aed-f539-42ad-a604-97c13b9f5efc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:13.179219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb59aed-f539-42ad-a604-97c13b9f5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:13.196135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2cb59aed-f539-42ad-a604-97c13b9f5efc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:13.197311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2cb59aed-f539-42ad-a604-97c13b9f5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:13.199240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:13.263612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 575/1132] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:13.287459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ade81-eb87-43c7-b3d2-9905b3c81cd9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:13.386511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ade81-eb87-43c7-b3d2-9905b3c81cd9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:13.419119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91d7c-e830-449f-8d72-c1c023bb7246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:13.419888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91d7c-e830-449f-8d72-c1c023bb7246 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:13.420173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91d7c-e830-449f-8d72-c1c023bb7246 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:13.420453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91d7c-e830-449f-8d72-c1c023bb7246 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:13.421667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91d7c-e830-449f-8d72-c1c023bb7246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:13.423657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91d7c-e830-449f-8d72-c1c023bb7246 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:13.425262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 558/1133] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:13:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:13.430910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb59aed-f539-42ad-a604-97c13b9f5efc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:13.528262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb59aed-f539-42ad-a604-97c13b9f5efc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:13.561059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05110f-6300-41d2-ab6e-235905f8bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:13.561711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05110f-6300-41d2-ab6e-235905f8bc57 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:13.561994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05110f-6300-41d2-ab6e-235905f8bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:13.562268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05110f-6300-41d2-ab6e-235905f8bc57 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:13.564073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05110f-6300-41d2-ab6e-235905f8bc57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:13.565518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05110f-6300-41d2-ab6e-235905f8bc57 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:13.573119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:13.643469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 576/1134] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:13:13 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:13:15.698799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e167f2d-40be-4c75-85ed-0c599fc58f13 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:15.699354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e167f2d-40be-4c75-85ed-0c599fc58f13 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:15.699354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e167f2d-40be-4c75-85ed-0c599fc58f13 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:15.700731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 559/1135] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:15.706528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e5a09-c046-41ba-9aea-b2072a9fe618 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:15.706951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e5a09-c046-41ba-9aea-b2072a9fe618 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:15.707133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e5a09-c046-41ba-9aea-b2072a9fe618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:15.724052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bc7e5a09-c046-41ba-9aea-b2072a9fe618 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:15.725234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bc7e5a09-c046-41ba-9aea-b2072a9fe618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:15.789954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 577/1136] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:15.814362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e167f2d-40be-4c75-85ed-0c599fc58f13 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:15.820271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:15.913186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e167f2d-40be-4c75-85ed-0c599fc58f13 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:15.945512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ebf98-eadf-4047-b33b-f52e82c5f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:15.946279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebf98-eadf-4047-b33b-f52e82c5f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:15.946558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebf98-eadf-4047-b33b-f52e82c5f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:15.946857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebf98-eadf-4047-b33b-f52e82c5f5a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:15.948013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ebf98-eadf-4047-b33b-f52e82c5f5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:15.949499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ebf98-eadf-4047-b33b-f52e82c5f5a7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:15.951135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 560/1137] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:13:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:15.957664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e5a09-c046-41ba-9aea-b2072a9fe618 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:16.053852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e5a09-c046-41ba-9aea-b2072a9fe618 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:16.074057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:16.087915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83683055-2d1c-4594-9cc5-dc8990219bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:16.088579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683055-2d1c-4594-9cc5-dc8990219bd9 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:16.088867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683055-2d1c-4594-9cc5-dc8990219bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:16.089176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683055-2d1c-4594-9cc5-dc8990219bd9 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:16.089849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83683055-2d1c-4594-9cc5-dc8990219bd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:16.091318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83683055-2d1c-4594-9cc5-dc8990219bd9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:16.173470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 578/1138] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:13:15 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:13:18.232199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb4c9-1992-4057-9440-f2b7f63e2b33 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:18.232763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb4c9-1992-4057-9440-f2b7f63e2b33 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:18.232763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb4c9-1992-4057-9440-f2b7f63e2b33 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:18.234118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 561/1139] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:18.239891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14a23-fafd-4dec-8def-8d3c9da539d5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:18.240310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14a23-fafd-4dec-8def-8d3c9da539d5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:18.240452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e14a23-fafd-4dec-8def-8d3c9da539d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:18.256860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-15e14a23-fafd-4dec-8def-8d3c9da539d5 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:18.258040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-15e14a23-fafd-4dec-8def-8d3c9da539d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:18.323223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 579/1140] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:18.346710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcb4c9-1992-4057-9440-f2b7f63e2b33 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:18.416014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:18.445463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcb4c9-1992-4057-9440-f2b7f63e2b33 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:18.478825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:18.479600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:18.479886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:18.480164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:18.490696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:13:18.498319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:13:18.499522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:13:18.501478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 562/1141] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:13:18.506096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14a23-fafd-4dec-8def-8d3c9da539d5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:18.602480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e14a23-fafd-4dec-8def-8d3c9da539d5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:18.609543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:18.636349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:18.637484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:18.638137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:18.638462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:18.639260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:18.639575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:18.640970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:18.648792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 580/1142] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:18.654513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:18.752996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bd0d1-0dce-419a-8102-650e03999a34 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:18.780918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:18.785902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:18.786798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:18.791343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:18.791343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] PATH_INFO: `/v3/users/d0889b6078e84a758cc790d2a2d4949b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:18.801089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d0889b6078e84a758cc790d2a2d4949b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:18.802529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:18.804201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 563/1143] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:18 2022] GET /identity/v3/users/d0889b6078e84a758cc790d2a2d4949b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:18.809946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:18.908754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20ea80-c460-494f-8e76-84e9d4f1ddbe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:18.941804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:18.942443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:18.942758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:18.943042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:18.976988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:19.008866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:19.010246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:19.105204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 581/1144] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:13:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:13:19.111666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:19.207915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a9ffe-42b0-40e0-9a2d-476ea800d2c3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:19.241415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef44fc-1d3b-4bd8-a3af-50452c7cfea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:19.242283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef44fc-1d3b-4bd8-a3af-50452c7cfea5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:19.242573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef44fc-1d3b-4bd8-a3af-50452c7cfea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:19.242880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef44fc-1d3b-4bd8-a3af-50452c7cfea5 None admin] PATH_INFO: `/v3/projects/7e0bcf88a18d4f0788291226c83e4d11` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:19.244060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef44fc-1d3b-4bd8-a3af-50452c7cfea5 None admin] RBAC: Authorizing `identity:get_project(project_id=7e0bcf88a18d4f0788291226c83e4d11)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:19.245490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef44fc-1d3b-4bd8-a3af-50452c7cfea5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:19.247208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 564/1145] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:19 2022] GET /identity/v3/projects/7e0bcf88a18d4f0788291226c83e4d11 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:13:19.253227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:19.317121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:19.349902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02756f-df31-4c8d-a2e9-607de65ee61f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:19.382296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60393-3696-419f-8926-9fc853082f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:19.382961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60393-3696-419f-8926-9fc853082f03 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:19.383243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60393-3696-419f-8926-9fc853082f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:19.383516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60393-3696-419f-8926-9fc853082f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:19.384360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be60393-3696-419f-8926-9fc853082f03 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=7e0bcf88a18d4f0788291226c83e4d11, user.id=d0889b6078e84a758cc790d2a2d4949b) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:19.384669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be60393-3696-419f-8926-9fc853082f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:19.386091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be60393-3696-419f-8926-9fc853082f03 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:19.392570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 582/1146] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:13:19 2022] GET /identity/v3/role_assignments?user.id=d0889b6078e84a758cc790d2a2d4949b&scope.project.id=7e0bcf88a18d4f0788291226c83e4d11&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:21.388645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b0407-2945-4dc2-88d4-f74ed4ac429f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:21.389201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b0407-2945-4dc2-88d4-f74ed4ac429f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:21.389201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b0407-2945-4dc2-88d4-f74ed4ac429f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:21.390559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 565/1147] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:21.396327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcca16-07e3-4c51-8871-2a2043b77aaf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:21.396717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcca16-07e3-4c51-8871-2a2043b77aaf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:21.396899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcca16-07e3-4c51-8871-2a2043b77aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:21.414109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dcbcca16-07e3-4c51-8871-2a2043b77aaf None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:21.415331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dcbcca16-07e3-4c51-8871-2a2043b77aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:21.480401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 583/1148] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:21.503458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b0407-2945-4dc2-88d4-f74ed4ac429f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:21.562062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:21.604249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b0407-2945-4dc2-88d4-f74ed4ac429f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:21.637709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:21.638484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:21.638863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:21.639096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:21.649118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:13:21.656796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:13:21.657865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:13:21.658934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 566/1149] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:13:21.665772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcca16-07e3-4c51-8871-2a2043b77aaf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:21.724949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:21.770172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcca16-07e3-4c51-8871-2a2043b77aaf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:21.803462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:21.804128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:21.804415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:21.804696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:21.805438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:21.805747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:21.807146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:21.815738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 584/1150] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:21.821571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:21.927887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16fb9b-a89d-4a31-a36f-1cd35fb83979 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:21.945469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:21.964570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:21.965443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:21.965727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:21.966004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] PATH_INFO: `/v3/users/d0889b6078e84a758cc790d2a2d4949b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:21.967229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] RBAC: Authorizing `identity:get_user(user_id=d0889b6078e84a758cc790d2a2d4949b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:21.969489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:21.971939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 567/1151] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:21 2022] GET /identity/v3/users/d0889b6078e84a758cc790d2a2d4949b => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:21.978245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:22.088243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0d47-6314-401a-81a7-82f60f081706 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:22.112998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:22.124519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9c21f-8b20-429d-ae15-bce2f6887bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:22.125889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9c21f-8b20-429d-ae15-bce2f6887bba None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:22.126363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9c21f-8b20-429d-ae15-bce2f6887bba None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:22.126882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9c21f-8b20-429d-ae15-bce2f6887bba None admin] PATH_INFO: `/v3/projects/7e0bcf88a18d4f0788291226c83e4d11` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:22.128835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9c21f-8b20-429d-ae15-bce2f6887bba None admin] RBAC: Authorizing `identity:get_project(project_id=7e0bcf88a18d4f0788291226c83e4d11)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:22.131370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9c21f-8b20-429d-ae15-bce2f6887bba None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:22.133749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 585/1152] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:21 2022] GET /identity/v3/projects/7e0bcf88a18d4f0788291226c83e4d11 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:22.140437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:22.243518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6080647-a521-4aef-bf67-0ad33943d064 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:22.277079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93869695-08ad-458d-910c-d0491f98b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:22.277971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93869695-08ad-458d-910c-d0491f98b4d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:22.278263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93869695-08ad-458d-910c-d0491f98b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:22.278543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93869695-08ad-458d-910c-d0491f98b4d6 None admin] PATH_INFO: `/v3/projects/7e0bcf88a18d4f0788291226c83e4d11/users/d0889b6078e84a758cc790d2a2d4949b/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:22.280528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93869695-08ad-458d-910c-d0491f98b4d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0bcf88a18d4f0788291226c83e4d11, user_id=d0889b6078e84a758cc790d2a2d4949b, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:22.282484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93869695-08ad-458d-910c-d0491f98b4d6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:22.358310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 568/1153] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:13:22 2022] PUT /identity/v3/projects/7e0bcf88a18d4f0788291226c83e4d11/users/d0889b6078e84a758cc790d2a2d4949b/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:13:24.384085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452d88d-0230-476a-aa5c-7c2c7df12e71 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:24.384655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452d88d-0230-476a-aa5c-7c2c7df12e71 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:24.384655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452d88d-0230-476a-aa5c-7c2c7df12e71 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:24.386018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 586/1154] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:24.391691 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c98821-ffc2-4a82-9602-07008c2c5072 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:24.392608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c98821-ffc2-4a82-9602-07008c2c5072 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:24.392856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c98821-ffc2-4a82-9602-07008c2c5072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:24.409253 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a8c98821-ffc2-4a82-9602-07008c2c5072 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:24.410427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a8c98821-ffc2-4a82-9602-07008c2c5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:24.450979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:24.475839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 569/1155] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:24.499241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452d88d-0230-476a-aa5c-7c2c7df12e71 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:24.601738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452d88d-0230-476a-aa5c-7c2c7df12e71 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:24.635309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266811c-9142-4597-85c9-12411731f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:24.636027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266811c-9142-4597-85c9-12411731f05f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:24.636308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266811c-9142-4597-85c9-12411731f05f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:24.636581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266811c-9142-4597-85c9-12411731f05f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:24.646787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266811c-9142-4597-85c9-12411731f05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f266811c-9142-4597-85c9-12411731f05f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:13:24.654304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:13:24.655445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:24.656551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:13:24.658798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 587/1156] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:13:24.661652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c98821-ffc2-4a82-9602-07008c2c5072 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:24.758342 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c98821-ffc2-4a82-9602-07008c2c5072 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:24.791110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:24.791769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:24.792054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:24.792330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:24.793073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:24.793410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:24.794805 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:24.803382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 570/1157] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:24.809051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266811c-9142-4597-85c9-12411731f05f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:24.862183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:24.909642 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266811c-9142-4597-85c9-12411731f05f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:24.948791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:24.949664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:24.949948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:24.950222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] PATH_INFO: `/v3/users/d0889b6078e84a758cc790d2a2d4949b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:24.951434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] RBAC: Authorizing `identity:get_user(user_id=d0889b6078e84a758cc790d2a2d4949b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:24.952877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:24.954766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 588/1158] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:24 2022] GET /identity/v3/users/d0889b6078e84a758cc790d2a2d4949b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:24.960662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:25.002339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:25.061750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318bdde-189f-469a-9f6b-ae9f3f6d2e2f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:25.093406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:25.094593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:25.094906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:25.095206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:25.159824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:25.161208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:25.197317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:25.256218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 571/1159] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:13:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:13:25.262367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:25.360325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7401f-c16d-48b4-bf6f-dd11efb62a93 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:25.378989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:25.393258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0a1ec-85ba-4576-a7d2-866a7023f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:25.394106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a1ec-85ba-4576-a7d2-866a7023f460 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:25.394390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a1ec-85ba-4576-a7d2-866a7023f460 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:25.394692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a1ec-85ba-4576-a7d2-866a7023f460 None admin] PATH_INFO: `/v3/projects/7e0bcf88a18d4f0788291226c83e4d11` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:25.395873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0a1ec-85ba-4576-a7d2-866a7023f460 None admin] RBAC: Authorizing `identity:get_project(project_id=7e0bcf88a18d4f0788291226c83e4d11)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:25.397285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0a1ec-85ba-4576-a7d2-866a7023f460 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:25.399001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 589/1160] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:25 2022] GET /identity/v3/projects/7e0bcf88a18d4f0788291226c83e4d11 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:25.405130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:25.502410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361dfbd-5623-4fdb-9b1a-62170fb417ef None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:25.536495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4767f-a8c4-4980-8ce6-15c8e1bd2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:25.537145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4767f-a8c4-4980-8ce6-15c8e1bd2af0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:25.537430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4767f-a8c4-4980-8ce6-15c8e1bd2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:25.537708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4767f-a8c4-4980-8ce6-15c8e1bd2af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:25.538535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4767f-a8c4-4980-8ce6-15c8e1bd2af0 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=7e0bcf88a18d4f0788291226c83e4d11, user.id=d0889b6078e84a758cc790d2a2d4949b) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:25.538884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4767f-a8c4-4980-8ce6-15c8e1bd2af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:25.540316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4767f-a8c4-4980-8ce6-15c8e1bd2af0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:25.545971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 572/1161] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:13:25 2022] GET /identity/v3/role_assignments?user.id=d0889b6078e84a758cc790d2a2d4949b&scope.project.id=7e0bcf88a18d4f0788291226c83e4d11&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:27.566389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f2e6-86a9-4a5c-806e-171835673cc9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:27.566940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f2e6-86a9-4a5c-806e-171835673cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:27.567125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577f2e6-86a9-4a5c-806e-171835673cc9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:27.568326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 590/1162] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:27.573510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787cf4-317e-48b1-89f5-9f2661e472a7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:27.573880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787cf4-317e-48b1-89f5-9f2661e472a7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:27.574069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f787cf4-317e-48b1-89f5-9f2661e472a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:27.579709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:27.591420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5f787cf4-317e-48b1-89f5-9f2661e472a7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:27.592594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5f787cf4-317e-48b1-89f5-9f2661e472a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:27.658520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 573/1163] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:27.680768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f2e6-86a9-4a5c-806e-171835673cc9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:27.779904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577f2e6-86a9-4a5c-806e-171835673cc9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:27.812106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:27.812863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:27.813148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:27.813426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:27.867427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:27.879727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:27.881296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:27.979132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 591/1164] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:13:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:13:27.985049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f787cf4-317e-48b1-89f5-9f2661e472a7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:28.081308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f787cf4-317e-48b1-89f5-9f2661e472a7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:28.108733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:28.113381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b6397-e325-4054-b517-712e45fdc2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:28.114166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6397-e325-4054-b517-712e45fdc2bb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:28.114446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6397-e325-4054-b517-712e45fdc2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:28.114746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b6397-e325-4054-b517-712e45fdc2bb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:28.121171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b6397-e325-4054-b517-712e45fdc2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:28.122593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b6397-e325-4054-b517-712e45fdc2bb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-388b6397-e325-4054-b517-712e45fdc2bb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:13:28.137539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:13:28.138633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:13:28.145177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 574/1165] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:13:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:13:28.146140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:28.229385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:28.240741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a0a7-beb4-4763-9abc-0ad86b75e2b7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:28.275026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e757c-5c43-4239-91a3-071792abd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:28.275698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e757c-5c43-4239-91a3-071792abd40f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:28.275978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e757c-5c43-4239-91a3-071792abd40f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:28.276252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e757c-5c43-4239-91a3-071792abd40f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:28.276962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e757c-5c43-4239-91a3-071792abd40f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:28.277268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e757c-5c43-4239-91a3-071792abd40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:28.278637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e757c-5c43-4239-91a3-071792abd40f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:28.285682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 592/1166] 10.222.0.87 () {56 vars in 1115 bytes} [Wed Jul 20 15:13:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:30.290027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57eda1-ae71-49a4-8637-0d292f27989b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:30.290596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57eda1-ae71-49a4-8637-0d292f27989b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:30.290596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57eda1-ae71-49a4-8637-0d292f27989b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:30.292059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 575/1167] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:30.297725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6510-ad8b-4745-9304-fdd8b288f380 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:30.298199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6510-ad8b-4745-9304-fdd8b288f380 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:30.298317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc6510-ad8b-4745-9304-fdd8b288f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:30.314693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b8bc6510-ad8b-4745-9304-fdd8b288f380 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:30.315888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8bc6510-ad8b-4745-9304-fdd8b288f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:30.380951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 593/1168] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:30.403859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57eda1-ae71-49a4-8637-0d292f27989b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:30.504147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57eda1-ae71-49a4-8637-0d292f27989b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:30.537633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460efec8-2d28-4f2e-ad50-e9d5bb640293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:30.538285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460efec8-2d28-4f2e-ad50-e9d5bb640293 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:30.538572 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460efec8-2d28-4f2e-ad50-e9d5bb640293 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:30.538881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460efec8-2d28-4f2e-ad50-e9d5bb640293 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:30.539619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460efec8-2d28-4f2e-ad50-e9d5bb640293 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:30.541040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460efec8-2d28-4f2e-ad50-e9d5bb640293 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:30.614704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 576/1169] 10.222.0.87 () {60 vars in 1138 bytes} [Wed Jul 20 15:13:30 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:13:32.657665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911f721-2515-4aab-9d67-bd9a065ea2a7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:32.658197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911f721-2515-4aab-9d67-bd9a065ea2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:32.658197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911f721-2515-4aab-9d67-bd9a065ea2a7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:32.659721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 594/1170] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:32.664845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb20dc-296f-48fe-a917-187d1a2b42d4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:32.665240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb20dc-296f-48fe-a917-187d1a2b42d4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:32.665411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb20dc-296f-48fe-a917-187d1a2b42d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:32.682229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c7bb20dc-296f-48fe-a917-187d1a2b42d4 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:32.683436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c7bb20dc-296f-48fe-a917-187d1a2b42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:32.728244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:32.747444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 577/1171] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:32.771051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911f721-2515-4aab-9d67-bd9a065ea2a7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:32.854608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:32.873257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911f721-2515-4aab-9d67-bd9a065ea2a7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:32.907829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1b856-5d26-4b26-a6a2-dec88cdc9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:32.908681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1b856-5d26-4b26-a6a2-dec88cdc9dfb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:32.908964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1b856-5d26-4b26-a6a2-dec88cdc9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:32.909239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1b856-5d26-4b26-a6a2-dec88cdc9dfb None admin] PATH_INFO: `/v3/domains/54f0de6dcd1845359485309a16b657a0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:32.919317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1b856-5d26-4b26-a6a2-dec88cdc9dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=54f0de6dcd1845359485309a16b657a0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:32.920769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1b856-5d26-4b26-a6a2-dec88cdc9dfb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:32.922687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 595/1172] 10.222.0.87 () {56 vars in 1183 bytes} [Wed Jul 20 15:13:32 2022] GET /identity/v3/domains/54f0de6dcd1845359485309a16b657a0 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:32.928726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb20dc-296f-48fe-a917-187d1a2b42d4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:33.024855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb20dc-296f-48fe-a917-187d1a2b42d4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:33.057554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69e133-2c99-4f3b-80d5-dce3c8a1d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:33.058196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69e133-2c99-4f3b-80d5-dce3c8a1d906 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:33.058482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69e133-2c99-4f3b-80d5-dce3c8a1d906 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:33.058793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69e133-2c99-4f3b-80d5-dce3c8a1d906 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:33.059491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69e133-2c99-4f3b-80d5-dce3c8a1d906 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:33.060921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69e133-2c99-4f3b-80d5-dce3c8a1d906 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:33.146330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 578/1173] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:13:32 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:13:35.202082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5eb6-06b7-41f5-b93f-c6a9a3075503 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:35.202614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5eb6-06b7-41f5-b93f-c6a9a3075503 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:35.202734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5eb6-06b7-41f5-b93f-c6a9a3075503 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:35.204072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 596/1174] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:35.209221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51986-ca0f-481f-9ed3-cfd7c3374c73 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:35.209625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51986-ca0f-481f-9ed3-cfd7c3374c73 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:35.209782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51986-ca0f-481f-9ed3-cfd7c3374c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:35.226194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-27f51986-ca0f-481f-9ed3-cfd7c3374c73 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:35.227409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-27f51986-ca0f-481f-9ed3-cfd7c3374c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:35.254106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:35.292650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 579/1175] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:35.317891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5eb6-06b7-41f5-b93f-c6a9a3075503 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:35.416285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5eb6-06b7-41f5-b93f-c6a9a3075503 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:35.449678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f9fd3-a3ce-4c3c-998c-6f4927ee75d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:35.450520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f9fd3-a3ce-4c3c-998c-6f4927ee75d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:35.450832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f9fd3-a3ce-4c3c-998c-6f4927ee75d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:35.451107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f9fd3-a3ce-4c3c-998c-6f4927ee75d3 None admin] PATH_INFO: `/v3/domains/54f0de6dcd1845359485309a16b657a0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:35.452308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f9fd3-a3ce-4c3c-998c-6f4927ee75d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=54f0de6dcd1845359485309a16b657a0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:35.454074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f9fd3-a3ce-4c3c-998c-6f4927ee75d3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:35.455696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 597/1176] 10.222.0.87 () {56 vars in 1183 bytes} [Wed Jul 20 15:13:35 2022] GET /identity/v3/domains/54f0de6dcd1845359485309a16b657a0 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:35.461344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f51986-ca0f-481f-9ed3-cfd7c3374c73 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:35.557297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f51986-ca0f-481f-9ed3-cfd7c3374c73 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:35.589288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1540f-fca7-47ac-9198-65df3d02be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:35.589934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1540f-fca7-47ac-9198-65df3d02be76 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:35.590216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1540f-fca7-47ac-9198-65df3d02be76 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:35.590490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1540f-fca7-47ac-9198-65df3d02be76 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:35.591210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1540f-fca7-47ac-9198-65df3d02be76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:35.592634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1540f-fca7-47ac-9198-65df3d02be76 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:35.652561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 580/1177] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:13:35 2022] POST /identity/v3/users => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:13:37.706767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182b61-f8f4-466c-89b9-18faad12f169 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:37.707339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182b61-f8f4-466c-89b9-18faad12f169 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:37.707339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd182b61-f8f4-466c-89b9-18faad12f169 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:37.708681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 598/1178] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:37.714054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba0400-aff7-4e9c-8bb7-202a384f657a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:37.714479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba0400-aff7-4e9c-8bb7-202a384f657a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:37.714609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba0400-aff7-4e9c-8bb7-202a384f657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:37.736661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6aba0400-aff7-4e9c-8bb7-202a384f657a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:37.737837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6aba0400-aff7-4e9c-8bb7-202a384f657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:37.751585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:37.804330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 581/1179] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:37.837033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd182b61-f8f4-466c-89b9-18faad12f169 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:37.850257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:37.937534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd182b61-f8f4-466c-89b9-18faad12f169 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:37.970436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:37.971263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:37.971552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:37.971832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:37.981748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:13:37.990045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:13:37.991254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:13:37.992527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 599/1180] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:13:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:13:37.997314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba0400-aff7-4e9c-8bb7-202a384f657a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:38.095761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba0400-aff7-4e9c-8bb7-202a384f657a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:38.127889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:38.128534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:38.128815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:38.129088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:38.129820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:38.130150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:38.131536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:38.139721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 582/1181] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:38.146060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:38.221456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:38.251692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed94395-f908-4ada-ac32-024e4f31b91e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:38.285192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:38.286059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:38.286347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:38.286630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] PATH_INFO: `/v3/users/c118105e368e4c7287e460550de925fa` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:38.299312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] RBAC: Authorizing `identity:get_user(user_id=c118105e368e4c7287e460550de925fa)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:38.300757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:38.302408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 600/1182] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:38 2022] GET /identity/v3/users/c118105e368e4c7287e460550de925fa => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:38.308373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:38.324392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:38.409910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312684ff-7de5-47b3-bb2a-bc27157a5838 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:38.445138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:38.445771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:38.446053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:38.446328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:38.515379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:38.517787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:38.530836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:38.616692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 583/1183] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:13:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:13:38.622634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:38.725327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff252d6-99aa-41c0-89f0-ac3cff2a9839 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:38.751386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:38.758850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bbd3d-db24-4daf-83e9-f10f5814a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:38.759710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bbd3d-db24-4daf-83e9-f10f5814a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:38.759995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bbd3d-db24-4daf-83e9-f10f5814a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:38.760270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bbd3d-db24-4daf-83e9-f10f5814a6e9 None admin] PATH_INFO: `/v3/projects/f464d623bde945d89a22d2a348c28b0f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:38.761442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bbd3d-db24-4daf-83e9-f10f5814a6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=f464d623bde945d89a22d2a348c28b0f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:38.763155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bbd3d-db24-4daf-83e9-f10f5814a6e9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:38.764847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 601/1184] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:38 2022] GET /identity/v3/projects/f464d623bde945d89a22d2a348c28b0f => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:38.771586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:38.867325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a468a2a-0f70-4e05-b483-b895bb508199 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:38.880652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:38.901767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dff39-2d59-45bf-a373-257ab2269844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:38.902408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dff39-2d59-45bf-a373-257ab2269844 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:38.902716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dff39-2d59-45bf-a373-257ab2269844 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:38.902994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dff39-2d59-45bf-a373-257ab2269844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:38.903828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dff39-2d59-45bf-a373-257ab2269844 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=f464d623bde945d89a22d2a348c28b0f, user.id=c118105e368e4c7287e460550de925fa) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:38.904349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dff39-2d59-45bf-a373-257ab2269844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:38.906070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dff39-2d59-45bf-a373-257ab2269844 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:38.911588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 584/1185] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:13:38 2022] GET /identity/v3/role_assignments?user.id=c118105e368e4c7287e460550de925fa&scope.project.id=f464d623bde945d89a22d2a348c28b0f&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:40.912647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830188-8d9b-4545-9cc2-436762efc1c3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:40.919265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830188-8d9b-4545-9cc2-436762efc1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:40.919265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830188-8d9b-4545-9cc2-436762efc1c3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:40.919265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 602/1186] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:40.919838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bbf03-d536-4320-8413-f37b1439747d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:40.920209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bbf03-d536-4320-8413-f37b1439747d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:40.920388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bbf03-d536-4320-8413-f37b1439747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:40.937725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3f8bbf03-d536-4320-8413-f37b1439747d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:40.938925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3f8bbf03-d536-4320-8413-f37b1439747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:41.004150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 585/1187] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:41.026829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed830188-8d9b-4545-9cc2-436762efc1c3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:41.125495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed830188-8d9b-4545-9cc2-436762efc1c3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:41.159635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:41.160412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:41.160697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:41.160976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:41.170844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:13:41.178320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:13:41.179452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:13:41.180342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 603/1188] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:13:41.185482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bbf03-d536-4320-8413-f37b1439747d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:41.282697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bbf03-d536-4320-8413-f37b1439747d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:41.290411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:41.316949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:41.317602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:41.317883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:41.318156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:41.318932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:41.319242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:41.320603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:41.329189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 586/1189] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:41.334650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:41.389763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:41.433053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62dc2e-5023-4eac-b08c-9d91cb33d508 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:41.465412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:41.466270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:41.466555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:41.466864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] PATH_INFO: `/v3/users/c118105e368e4c7287e460550de925fa` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:41.468041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] RBAC: Authorizing `identity:get_user(user_id=c118105e368e4c7287e460550de925fa)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:41.470061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:41.471701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 604/1190] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:41 2022] GET /identity/v3/users/c118105e368e4c7287e460550de925fa => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:41.477540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:41.575598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21ab4-bf3d-4fa4-97cd-d6220aa061cc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:41.608113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfca99-dcd7-4b24-98ef-6706c9aeb285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:41.608958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfca99-dcd7-4b24-98ef-6706c9aeb285 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:41.609340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfca99-dcd7-4b24-98ef-6706c9aeb285 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:41.609741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfca99-dcd7-4b24-98ef-6706c9aeb285 None admin] PATH_INFO: `/v3/projects/f464d623bde945d89a22d2a348c28b0f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:41.610985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfca99-dcd7-4b24-98ef-6706c9aeb285 None admin] RBAC: Authorizing `identity:get_project(project_id=f464d623bde945d89a22d2a348c28b0f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:41.612404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfca99-dcd7-4b24-98ef-6706c9aeb285 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:41.614076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 587/1191] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:41 2022] GET /identity/v3/projects/f464d623bde945d89a22d2a348c28b0f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:41.619983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:41.718069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ad49e-9d03-4b54-8cbb-4c515309a2cc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:41.741755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:41.752724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f87c5a-11cc-4208-9418-bffff7de10b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:41.753618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87c5a-11cc-4208-9418-bffff7de10b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:41.758906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87c5a-11cc-4208-9418-bffff7de10b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:41.758906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f87c5a-11cc-4208-9418-bffff7de10b5 None admin] PATH_INFO: `/v3/projects/f464d623bde945d89a22d2a348c28b0f/users/c118105e368e4c7287e460550de925fa/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:41.758906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f87c5a-11cc-4208-9418-bffff7de10b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f464d623bde945d89a22d2a348c28b0f, user_id=c118105e368e4c7287e460550de925fa, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:41.758906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f87c5a-11cc-4208-9418-bffff7de10b5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:41.830937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 605/1192] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:13:41 2022] PUT /identity/v3/projects/f464d623bde945d89a22d2a348c28b0f/users/c118105e368e4c7287e460550de925fa/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:13:43.869019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75fe25-e6cd-4959-b701-5f44e01eb0df None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:43.869550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75fe25-e6cd-4959-b701-5f44e01eb0df None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:43.869644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75fe25-e6cd-4959-b701-5f44e01eb0df None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:43.870991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 588/1193] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:13:43.876672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c108-9c1d-470e-98a7-48b0945557da None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:43.877049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c108-9c1d-470e-98a7-48b0945557da None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:43.877228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c108-9c1d-470e-98a7-48b0945557da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:43.894316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8ec6c108-9c1d-470e-98a7-48b0945557da None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:13:43.895513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8ec6c108-9c1d-470e-98a7-48b0945557da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:13:43.960474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 606/1194] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:13:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:13:43.983901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75fe25-e6cd-4959-b701-5f44e01eb0df None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:44.020206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:44.083627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75fe25-e6cd-4959-b701-5f44e01eb0df None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:44.116473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944202-037a-4006-9eba-7106a53b092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:44.117247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944202-037a-4006-9eba-7106a53b092b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:44.117531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944202-037a-4006-9eba-7106a53b092b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:44.117809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944202-037a-4006-9eba-7106a53b092b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:44.127714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64944202-037a-4006-9eba-7106a53b092b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-64944202-037a-4006-9eba-7106a53b092b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:13:44.135200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:13:44.136305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:13:44.137615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 589/1195] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:13:44.143583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6c108-9c1d-470e-98a7-48b0945557da None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:44.239906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6c108-9c1d-470e-98a7-48b0945557da None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:44.253865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:44.274218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:44.274907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:44.275208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:44.275465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:44.276196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:44.276501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:44.277859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:44.287153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 607/1196] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:44.292894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944202-037a-4006-9eba-7106a53b092b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:44.385168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:44.391729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944202-037a-4006-9eba-7106a53b092b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:44.425121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:44.425975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:44.426261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:44.426539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] PATH_INFO: `/v3/users/c118105e368e4c7287e460550de925fa` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:44.427754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] RBAC: Authorizing `identity:get_user(user_id=c118105e368e4c7287e460550de925fa)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:44.429189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:44.430859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 590/1197] 10.222.0.87 () {56 vars in 1177 bytes} [Wed Jul 20 15:13:44 2022] GET /identity/v3/users/c118105e368e4c7287e460550de925fa => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:44.436552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:44.535537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f138-391f-4e6b-afcf-f2dc1e62b8e1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:44.568203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:44.568838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:44.569120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:44.569396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:44.613192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:44.635369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:44.636755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:44.734053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 608/1198] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:13:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:13:44.740001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:44.838436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b25cc-d238-4c66-8f87-fec134924546 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:44.872054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a6486-260c-4762-8711-05c11c8a2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:44.872899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a6486-260c-4762-8711-05c11c8a2b2f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:44.873178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a6486-260c-4762-8711-05c11c8a2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:44.873449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a6486-260c-4762-8711-05c11c8a2b2f None admin] PATH_INFO: `/v3/projects/f464d623bde945d89a22d2a348c28b0f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:44.874620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a6486-260c-4762-8711-05c11c8a2b2f None admin] RBAC: Authorizing `identity:get_project(project_id=f464d623bde945d89a22d2a348c28b0f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:44.876706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a6486-260c-4762-8711-05c11c8a2b2f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:44.878403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 591/1199] 10.222.0.87 () {56 vars in 1186 bytes} [Wed Jul 20 15:13:44 2022] GET /identity/v3/projects/f464d623bde945d89a22d2a348c28b0f => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:44.884524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:13:44.960337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:44.982629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b345a6-4181-4fd0-ad36-279b930b91aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:13:45.017128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfc61b-e846-49b4-8c46-5efcca2cb07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:13:45.017775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc61b-e846-49b4-8c46-5efcca2cb07b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:13:45.018061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc61b-e846-49b4-8c46-5efcca2cb07b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:13:45.018338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc61b-e846-49b4-8c46-5efcca2cb07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:13:45.019201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfc61b-e846-49b4-8c46-5efcca2cb07b None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=f464d623bde945d89a22d2a348c28b0f, user.id=c118105e368e4c7287e460550de925fa) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:13:45.019517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfc61b-e846-49b4-8c46-5efcca2cb07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:13:45.020945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfc61b-e846-49b4-8c46-5efcca2cb07b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:13:45.026625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 609/1200] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:13:44 2022] GET /identity/v3/role_assignments?user.id=c118105e368e4c7287e460550de925fa&scope.project.id=f464d623bde945d89a22d2a348c28b0f&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:13:54.867823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:13:55.024012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=30 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.394407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a16ee-27d1-45d2-9084-8ac97c44ee50 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.395047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a16ee-27d1-45d2-9084-8ac97c44ee50 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.395047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a16ee-27d1-45d2-9084-8ac97c44ee50 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.396365 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 592/1201] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:56.401634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc87d0-c4ac-4ffd-ae02-f56c75e6a6a8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.402054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc87d0-c4ac-4ffd-ae02-f56c75e6a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.402196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc87d0-c4ac-4ffd-ae02-f56c75e6a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.418518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9bdc87d0-c4ac-4ffd-ae02-f56c75e6a6a8 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:56.419728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9bdc87d0-c4ac-4ffd-ae02-f56c75e6a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:56.486292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 610/1202] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:14:56.512124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a16ee-27d1-45d2-9084-8ac97c44ee50 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.617086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a16ee-27d1-45d2-9084-8ac97c44ee50 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.652087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.652804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.653087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.653389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.663993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.665472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:14:56.682876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:56.684000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:56.685214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:14:56.685214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:14:56.685214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:56.685214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:14:56.685214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 593/1203] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:56.690956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc87d0-c4ac-4ffd-ae02-f56c75e6a6a8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.790497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc87d0-c4ac-4ffd-ae02-f56c75e6a6a8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.819264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.824930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ffcc0-1040-4f35-9ac7-6f26db8dd6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.825597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ffcc0-1040-4f35-9ac7-6f26db8dd6af None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.825884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ffcc0-1040-4f35-9ac7-6f26db8dd6af None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.826162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ffcc0-1040-4f35-9ac7-6f26db8dd6af None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.826923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ffcc0-1040-4f35-9ac7-6f26db8dd6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:56.827236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ffcc0-1040-4f35-9ac7-6f26db8dd6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.828605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ffcc0-1040-4f35-9ac7-6f26db8dd6af None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:56.839353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 611/1204] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:56.845089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:56.898241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:56.944302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c549167-407a-4e63-976c-f9a95a2b20be None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:56.976848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5779-03f5-459d-9cda-c479af5818fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:56.977507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5779-03f5-459d-9cda-c479af5818fb None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:56.977792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5779-03f5-459d-9cda-c479af5818fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:56.978072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5779-03f5-459d-9cda-c479af5818fb None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:56.978808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e5779-03f5-459d-9cda-c479af5818fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:56.980246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e5779-03f5-459d-9cda-c479af5818fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:57.058831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 594/1205] 10.222.0.87 () {60 vars in 1132 bytes} [Wed Jul 20 15:14:56 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:14:59.147748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ec7b-2e0f-4a09-90d2-650b562addb9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.148315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ec7b-2e0f-4a09-90d2-650b562addb9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.148315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ec7b-2e0f-4a09-90d2-650b562addb9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.149659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 612/1206] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:14:59.154821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978908d-be1b-4e65-96ed-d634ae03e441 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.155274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978908d-be1b-4e65-96ed-d634ae03e441 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.155377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978908d-be1b-4e65-96ed-d634ae03e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.172734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d978908d-be1b-4e65-96ed-d634ae03e441 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:14:59.173915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d978908d-be1b-4e65-96ed-d634ae03e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:14:59.240242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 595/1207] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:14:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:14:59.264644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ec7b-2e0f-4a09-90d2-650b562addb9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.367512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ec7b-2e0f-4a09-90d2-650b562addb9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.401868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.402600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.402921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.403198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.413396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:14:59.421097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:59.422100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:14:59.423190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 613/1208] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:59.428317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978908d-be1b-4e65-96ed-d634ae03e441 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.467754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.526904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978908d-be1b-4e65-96ed-d634ae03e441 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.559117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.559819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.560127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.560405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.561146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:59.561454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.562851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.571441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 596/1209] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:14:59.577280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.628511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.677701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388def-4315-4094-b127-d5f1bc8a2e65 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.711789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.712576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.712862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.713140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.724311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.727075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:14:59.743129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:14:59.745582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:14:59.746757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:14:59.746757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:14:59.746757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:14:59.746757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:14:59.746757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 614/1210] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:14:59.750379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:14:59.846972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:14:59.849769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff57aa-cdfa-47ce-9097-9947bb5fdbb2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:14:59.883786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:14:59.884446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:14:59.884728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:14:59.885006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:14:59.885751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:14:59.886059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:14:59.887456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:14:59.898860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 597/1211] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:14:59.904699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.001813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48056ffe-3caf-40b9-8618-05dfd36b805e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.003865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.035424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.041142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.041142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.041142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.043526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.044963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:00.060477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:00.061665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:00.066221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:00.067040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 615/1212] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:14:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:00.068357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.169807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f9b9-a782-404c-8b67-5a3b162f7399 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.203688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.204398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.204657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.204933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.206290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:00.206598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.208047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.225312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 598/1213] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:00.231138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.330068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccf1ff-bd94-4528-9bec-1aac4147e340 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.364268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.364913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.365252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.365574 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.394895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.432258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.433706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.531695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 616/1214] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:15:00.538051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.557245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.636048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be3b55-9d61-47d1-b1c8-e9d44584790c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.670983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.671847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.672127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.672402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.682510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.683963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:00.701051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:00.702111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:00.703264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:00.703264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:00.703264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:00.703264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:00.703264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 599/1215] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:00.708652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.772325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.810135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c6469-ccc0-4957-8eba-765f9572ce36 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:00.844024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:00.844684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:00.844969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:00.845246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:00.846748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:00.847105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:00.848472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:00.860242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 617/1216] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:00.866127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:00.938708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:00.968672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd6d8-3e59-4d28-80a0-8b8e10b76c82 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.001011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.001798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.002599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.003201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.009455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.010979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:01.025386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:01.026507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:01.027561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 600/1217] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:01.032428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:01.131285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfb38f-b9b5-4e24-95c9-79147119227c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.153168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:01.165375 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf82d8-17e0-4cb6-9100-b1cfdb332e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.166024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf82d8-17e0-4cb6-9100-b1cfdb332e8f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.166304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf82d8-17e0-4cb6-9100-b1cfdb332e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.166578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf82d8-17e0-4cb6-9100-b1cfdb332e8f None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.167395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf82d8-17e0-4cb6-9100-b1cfdb332e8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:01.167701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf82d8-17e0-4cb6-9100-b1cfdb332e8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.169116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf82d8-17e0-4cb6-9100-b1cfdb332e8f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.181995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 618/1218] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:01.188156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:01.290850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5308a-5116-411b-aed3-a23bced1ccdb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:01.318729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:01.324358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aeeea-054d-4da3-89ec-7c49764aafd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:01.325003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aeeea-054d-4da3-89ec-7c49764aafd8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:01.325285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aeeea-054d-4da3-89ec-7c49764aafd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:01.325558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aeeea-054d-4da3-89ec-7c49764aafd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:01.326377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aeeea-054d-4da3-89ec-7c49764aafd8 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c8f8e30141ca4c95b5c11afefbb324c4) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:01.326712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aeeea-054d-4da3-89ec-7c49764aafd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:01.328134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aeeea-054d-4da3-89ec-7c49764aafd8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:01.334168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 601/1219] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:01 2022] GET /identity/v3/role_assignments?user.id=c8f8e30141ca4c95b5c11afefbb324c4&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:03.348115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c896-1876-4849-b792-b1ceb448948a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.348708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c896-1876-4849-b792-b1ceb448948a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.348807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100c896-1876-4849-b792-b1ceb448948a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.350159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 619/1220] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:03.355286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc537-9e1f-40c5-a0dc-ab91c3546d9b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.355715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc537-9e1f-40c5-a0dc-ab91c3546d9b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.355824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc537-9e1f-40c5-a0dc-ab91c3546d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.372444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d6fcc537-9e1f-40c5-a0dc-ab91c3546d9b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:03.373613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d6fcc537-9e1f-40c5-a0dc-ab91c3546d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:03.443094 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 602/1221] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:03.466523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100c896-1876-4849-b792-b1ceb448948a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.571219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100c896-1876-4849-b792-b1ceb448948a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.605006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.605730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.606011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.606286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.616548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:03.624173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:03.625354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:03.626396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 620/1222] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:03.632018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcc537-9e1f-40c5-a0dc-ab91c3546d9b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.730285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcc537-9e1f-40c5-a0dc-ab91c3546d9b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.754286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:03.764762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.765424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.765758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.766073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.766854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:03.767167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:03.769145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:03.777105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 603/1223] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:03.782915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:03.826243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:03.882340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd4ef4-8877-43a6-9a27-17c90b31aa4f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:03.916386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:03.917171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:03.917521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:03.917792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:03.928275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:03.929715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:03.946856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:03.947925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:03.948966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:03.948966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:03.948966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:03.948966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:03.948966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 621/1224] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:03.953862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.053880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84c293-44ea-4b92-85c0-266108d58b61 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.087137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.087881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.088130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.088411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.089132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:04.089484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.090835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.102293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 604/1225] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:04.108084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.202680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.209920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5af017-aebd-4baf-bcd9-a96c324d58dd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.243109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.243893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.244173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.244445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.251231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.253441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:04.267908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:04.269032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:04.270371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 622/1226] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:04.275008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.325751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.376396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b82b-fa12-4b4e-88ef-f43bce96bcb1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.409884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.410547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.410862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.411157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.411990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:04.412299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.413723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.430679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 605/1227] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:04.436518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.536015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522b5d7-afaa-4a00-9742-5c0736d24353 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.570171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.570987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.571321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.571638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.583134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.584592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:04.602212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:04.607687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:04.608701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:04.608701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:04.608701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:04.608701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:04.608701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 623/1228] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:04.609381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.708657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aac4a-3c8c-4f9e-afde-81935ccddefa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.710947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.742994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.743649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.743938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.744218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.744937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:04.745247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.746626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.757855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 606/1229] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:04.763883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:04.772820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:04.860398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208922d2-cfe2-4a3a-86e6-b6a62d4c01d1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:04.894051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:04.894872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:04.895160 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:04.895435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:04.901920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:04.903541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:04.918077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:04.924851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:04.925915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 624/1230] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:04.926515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:05.027036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018251d-4364-41e2-a73c-25f2f2d4224c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:05.060410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70359530-60f1-4963-baaa-2cf012259be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:05.061063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359530-60f1-4963-baaa-2cf012259be8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.061349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359530-60f1-4963-baaa-2cf012259be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.061627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70359530-60f1-4963-baaa-2cf012259be8 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.062418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70359530-60f1-4963-baaa-2cf012259be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:05.062840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70359530-60f1-4963-baaa-2cf012259be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:05.064346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70359530-60f1-4963-baaa-2cf012259be8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:05.076391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 607/1231] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:05.083343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:05.149029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:05.182063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeef39-8a5e-4768-b1c9-46a919338bf9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:05.215414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb895b1-e13a-41a8-918b-efd591a8981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:05.216302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb895b1-e13a-41a8-918b-efd591a8981b None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:05.216585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb895b1-e13a-41a8-918b-efd591a8981b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:05.216859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb895b1-e13a-41a8-918b-efd591a8981b None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c8f8e30141ca4c95b5c11afefbb324c4/roles/b95329feed8c4f02a509b901d6e9844b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:05.231604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb895b1-e13a-41a8-918b-efd591a8981b None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=c8f8e30141ca4c95b5c11afefbb324c4, role_id=b95329feed8c4f02a509b901d6e9844b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:05.233053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb895b1-e13a-41a8-918b-efd591a8981b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:05.332887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 625/1232] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:05 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c8f8e30141ca4c95b5c11afefbb324c4/roles/b95329feed8c4f02a509b901d6e9844b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:07.369090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb786bd-c02e-43be-8150-3bec4893ca44 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.369628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb786bd-c02e-43be-8150-3bec4893ca44 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.369628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb786bd-c02e-43be-8150-3bec4893ca44 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.371061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 608/1233] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:07.376292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7fec-adea-4bc6-9810-4ea3232c1375 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.376746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7fec-adea-4bc6-9810-4ea3232c1375 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.376847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7fec-adea-4bc6-9810-4ea3232c1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.394745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d01c7fec-adea-4bc6-9810-4ea3232c1375 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:07.395921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d01c7fec-adea-4bc6-9810-4ea3232c1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:07.461428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 626/1234] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:07.485098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb786bd-c02e-43be-8150-3bec4893ca44 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.513976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.587715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb786bd-c02e-43be-8150-3bec4893ca44 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:07.620748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:07.621467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.621746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.622026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.632328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:07.640214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:07.645062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:07.646050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 609/1235] 10.222.0.87 () {56 vars in 1102 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:07.648315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7fec-adea-4bc6-9810-4ea3232c1375 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.694683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.746172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7fec-adea-4bc6-9810-4ea3232c1375 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:07.780386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:07.781047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.781329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.781601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.782338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:07.782679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:07.784604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:07.792158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 627/1236] 10.222.0.87 () {56 vars in 1103 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:07.797999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:07.881533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:07.897543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4003c09-612c-4d36-bd49-2652b0bdcf66 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:07.931377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:07.932167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:07.932454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:07.932734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:07.942780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:07.944230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:07.961674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:07.967756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:07.968648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:07.968648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:07.968648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:07.968648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:07.968648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 610/1237] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:07.968933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:08.067450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f660b04-1a2b-4f95-9eee-d86ccd286add None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:08.076012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:08.101018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:08.101711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.101995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.102275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.103028 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:08.103362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:08.104718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:08.115967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 628/1238] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:08.121650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:08.223516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b46bc9-5aee-4a5b-a5f3-516291d61874 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:08.257216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:08.258010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.258295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.258570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.261323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:08.266205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:08.268331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:08.282663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:08.285818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:08.287008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 611/1239] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:08.290237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:08.390595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca66af8-ce51-4e52-a79b-9f4770f06f36 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:08.425307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:08.425980 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.426270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.426551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.427419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:08.427735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:08.429156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:08.446447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 629/1240] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Jul 20 15:15:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:08.452252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:08.553649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed889f-b54a-4830-8a9c-ccf482fa8574 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:08.587964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:08.588608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.588897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.589180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.648848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:08.655218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:08.656670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:08.754787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 612/1241] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:15:08.760573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:08.787635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:08.860455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d05fca-77d6-43ff-b086-ac630b5ced36 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:08.899280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:08.900081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:08.900380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:08.901215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:08.911269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:08.912855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:08.933502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:08.934770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:08.935953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:08.935953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:08.935953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:08.935953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:08.935953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 630/1242] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:08.941363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.033820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.039915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bbc94-20ec-4137-995d-dbb7cdebacad None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.073716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.074410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.074721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.075016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.075715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:09.076021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.077438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.088266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 613/1243] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:09.093891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.172067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:09.193357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796978-159b-45c4-868a-1a2deac3580c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.226418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.227242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.227534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.227809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.234349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.235832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:09.250259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:09.251464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:09.252704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 631/1244] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:09.257725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.363241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f25c-5c9e-4428-8e91-49e3406a01ff None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.397611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d8f50-8541-44dd-9ae1-fea5fee85fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.398264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8f50-8541-44dd-9ae1-fea5fee85fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.398546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8f50-8541-44dd-9ae1-fea5fee85fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.398850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8f50-8541-44dd-9ae1-fea5fee85fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.399670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d8f50-8541-44dd-9ae1-fea5fee85fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:09.399977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d8f50-8541-44dd-9ae1-fea5fee85fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.401394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d8f50-8541-44dd-9ae1-fea5fee85fb6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.413804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 614/1245] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:09.419908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:09.520349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9ee24-599b-47b0-a4ea-a6ef6240bd71 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:09.553236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e3122-13c4-43df-8969-5ff69303e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:09.553898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e3122-13c4-43df-8969-5ff69303e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:09.554179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e3122-13c4-43df-8969-5ff69303e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:09.554467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e3122-13c4-43df-8969-5ff69303e7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:09.555343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e3122-13c4-43df-8969-5ff69303e7d4 None admin] RBAC: Adding query filter params (role.id=b95329feed8c4f02a509b901d6e9844b, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c8f8e30141ca4c95b5c11afefbb324c4) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:09.555660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e3122-13c4-43df-8969-5ff69303e7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:09.557099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e3122-13c4-43df-8969-5ff69303e7d4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:09.562906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 632/1246] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:09 2022] GET /identity/v3/role_assignments?user.id=c8f8e30141ca4c95b5c11afefbb324c4&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=b95329feed8c4f02a509b901d6e9844b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:11.647564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d116e1-e375-464e-9fea-416ba7dd1373 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:11.648125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d116e1-e375-464e-9fea-416ba7dd1373 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:11.648125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d116e1-e375-464e-9fea-416ba7dd1373 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:11.649490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 615/1247] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:11.655011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261d272-0c18-4e32-91e2-bbd48b4a3e20 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:11.655804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261d272-0c18-4e32-91e2-bbd48b4a3e20 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:11.655804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261d272-0c18-4e32-91e2-bbd48b4a3e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:11.661118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:11.673031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1261d272-0c18-4e32-91e2-bbd48b4a3e20 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:11.675157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1261d272-0c18-4e32-91e2-bbd48b4a3e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:11.741862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 633/1248] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:11.765966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d116e1-e375-464e-9fea-416ba7dd1373 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:11.784667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:11.866597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d116e1-e375-464e-9fea-416ba7dd1373 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:11.899816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:11.900588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:11.900900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:11.901203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:11.911976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:11.919445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:11.920582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:11.921584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 616/1249] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:11.927316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261d272-0c18-4e32-91e2-bbd48b4a3e20 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.025742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261d272-0c18-4e32-91e2-bbd48b4a3e20 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.054256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.058914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.059576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.059858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.060133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.060872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:12.061177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.062533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:12.071121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 634/1250] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:12.076957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.153934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.177426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3d74b-abb3-468c-b520-aaa2b6c93305 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.209343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.210116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.210398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.210697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.221291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.222973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:12.240093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:12.241169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:12.242090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:12.242090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:12.242090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:12.242090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:12.242090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 617/1251] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:12.247214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.347799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f0bc8-d24e-4e1b-ba86-40c2c8d2cfbb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.381272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.381932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.382223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.382504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.383260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:12.383576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.384942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:12.398252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 635/1252] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:12.404067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.504168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8e85c-105d-4061-96fe-6a3c96757b19 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.530826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.539269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.540070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.540352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.540631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.547870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.549931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:12.563562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:12.564728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:12.565884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 618/1253] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:12.570989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.626542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.671260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d5e2b-f62c-4ba4-8a63-62aeda56d4c4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.703636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.704304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.704590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.704867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.706244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:12.706557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.708035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:12.726265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 636/1254] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:12.732026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:12.830991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333ac58-40e6-46a5-8766-774bdc1442f1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:12.863699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:12.864331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:12.864622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:12.864895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:12.918470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:12.929971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:12.934171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.028853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 619/1255] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:15:13.035181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.133177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b19b75-754f-47fe-9f6d-172bc7e3c4fc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.146762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.166712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.167494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.167780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.168055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.177888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.179304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:13.197395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:13.198522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:13.199785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:13.199785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:13.199785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:13.199785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:13.199785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 637/1256] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:13.204399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.293853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.306059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d6650-3d15-4f2b-ba5f-a31c7300d23f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.340894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.341552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.341835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.342111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.342914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:13.343223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.344580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.357030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 620/1257] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:13.362966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.460864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48482377-4657-41ab-b116-6c1ec04b7d7b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.495311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.496114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.496396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.496671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.503780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.505211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:13.519681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:13.520745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:13.521833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 638/1258] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:13.526835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.625640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da52f3-bcb3-47e4-9b1c-eadd47fc4868 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.661627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b9749-2ff7-4437-b1f5-4cc3e0e0f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.662282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9749-2ff7-4437-b1f5-4cc3e0e0f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.662569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9749-2ff7-4437-b1f5-4cc3e0e0f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.662876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9749-2ff7-4437-b1f5-4cc3e0e0f4e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.663647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b9749-2ff7-4437-b1f5-4cc3e0e0f4e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:13.663957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b9749-2ff7-4437-b1f5-4cc3e0e0f4e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.665377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b9749-2ff7-4437-b1f5-4cc3e0e0f4e5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.678610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 621/1259] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:13.684872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:13.712823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:13.783506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac9055-0297-4057-b840-21ba2f3e9234 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:13.817115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9af30-4cbe-4bea-acec-d58bfa19acd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:13.817768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9af30-4cbe-4bea-acec-d58bfa19acd8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:13.818054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9af30-4cbe-4bea-acec-d58bfa19acd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:13.818330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9af30-4cbe-4bea-acec-d58bfa19acd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:13.819196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9af30-4cbe-4bea-acec-d58bfa19acd8 None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c8f8e30141ca4c95b5c11afefbb324c4) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:13.819510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9af30-4cbe-4bea-acec-d58bfa19acd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:13.820957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9af30-4cbe-4bea-acec-d58bfa19acd8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:13.826353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 639/1260] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:13 2022] GET /identity/v3/role_assignments?user.id=c8f8e30141ca4c95b5c11afefbb324c4&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:15.857869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1b8f-9ca5-4440-a92c-db8f096fc07a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.858464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1b8f-9ca5-4440-a92c-db8f096fc07a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.858464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1b8f-9ca5-4440-a92c-db8f096fc07a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.859902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 622/1261] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:15.865480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a53e-a174-4a3e-81a2-213f7cb75433 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:15.865910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a53e-a174-4a3e-81a2-213f7cb75433 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:15.867518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a53e-a174-4a3e-81a2-213f7cb75433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:15.883718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ace7a53e-a174-4a3e-81a2-213f7cb75433 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:15.884896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ace7a53e-a174-4a3e-81a2-213f7cb75433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:15.949862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 640/1262] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:15.973701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae1b8f-9ca5-4440-a92c-db8f096fc07a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:15.985271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.073837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae1b8f-9ca5-4440-a92c-db8f096fc07a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.108878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.109605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.109883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.110154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.120380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:16.127786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:16.129386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:16.130416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 623/1263] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:16.136094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a53e-a174-4a3e-81a2-213f7cb75433 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.155457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.236308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a53e-a174-4a3e-81a2-213f7cb75433 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.271626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.272289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.272572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.272851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.273586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:16.273889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.275297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.283137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 641/1264] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:16.289337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.362981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.397675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e832de-f145-4a3d-9a71-277aa1e16154 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.430621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.431427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.431709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.431983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.442931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.444370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:16.461985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:16.463203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:16.464191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:16.464191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:16.464191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:16.464191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:16.464191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 624/1265] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:16.469478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.551995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.571065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f958d03-e5f2-44e4-a1b3-cfb37653e242 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.604505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.605166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.605448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.605723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.606439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:16.606775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.608125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.620142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 642/1266] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:16.626039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.726433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0f3ba-9ca6-48c4-8d18-1c961132d47c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.748204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.764447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.765292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.765571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.765845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.773453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.774918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:16.789767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:16.795578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:16.796736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 625/1267] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:16.797456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:16.896546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45a21d-faf2-4393-a306-dfd41a8fc60e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:16.932091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:16.932769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:16.933055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:16.933334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:16.934171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:16.934487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:16.935941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:16.944883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:16.952842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 643/1268] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:16.959216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.059649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78378-2da2-4034-aba0-6a9a95624d55 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.093888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.094701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.094993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.095272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.106384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.107928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:17.124857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:17.125919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:17.127165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:17.127165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:17.127165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:17.127165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:17.127165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 626/1269] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 15:15:17.131932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.232824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a12e2-0c3e-48c2-98ef-4002cc727598 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.265696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.266353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.266662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.266944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.267663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:17.267971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.269347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.280742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 644/1270] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:17.287215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.319421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:17.391737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213f410-97ae-48d8-a1c0-a4aca1a3743d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.430540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.431367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.431651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.431926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.439019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.440489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:17.454510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:17.455729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:17.457396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 627/1271] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:17.462224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.524988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:17.567306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d6d6-2cfc-446e-8b98-9d005b6f6080 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.601957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edad42-2e92-479b-a83f-4ff5dea5e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.602631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edad42-2e92-479b-a83f-4ff5dea5e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.602944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edad42-2e92-479b-a83f-4ff5dea5e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.603222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edad42-2e92-479b-a83f-4ff5dea5e5b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.604040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edad42-2e92-479b-a83f-4ff5dea5e5b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:17.604355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edad42-2e92-479b-a83f-4ff5dea5e5b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.605878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edad42-2e92-479b-a83f-4ff5dea5e5b8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.618605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 645/1272] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:17.624625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:17.716630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:17.726149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd791b-c649-4943-9d23-cae397f1e276 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:17.760075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22639-5310-486f-89f9-c639d88740d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:17.760965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22639-5310-486f-89f9-c639d88740d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:17.761250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22639-5310-486f-89f9-c639d88740d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:17.761527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22639-5310-486f-89f9-c639d88740d1 None admin] PATH_INFO: `/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c8f8e30141ca4c95b5c11afefbb324c4/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:17.763830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22639-5310-486f-89f9-c639d88740d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=081b73d4e6644ae189d605f40bae7d94, user_id=c8f8e30141ca4c95b5c11afefbb324c4, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:17.765212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22639-5310-486f-89f9-c639d88740d1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:17.950325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 628/1273] 10.222.0.87 () {58 vars in 1439 bytes} [Wed Jul 20 15:15:17 2022] PUT /identity/v3/projects/081b73d4e6644ae189d605f40bae7d94/users/c8f8e30141ca4c95b5c11afefbb324c4/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:15:19.979915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8e2a-3916-41df-ae0e-052376683e5e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.980462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8e2a-3916-41df-ae0e-052376683e5e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.980578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8e2a-3916-41df-ae0e-052376683e5e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:19.981876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 646/1274] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:19.987081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87871-7937-4de1-81db-515d8c87259f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:19.987542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87871-7937-4de1-81db-515d8c87259f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:19.987637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87871-7937-4de1-81db-515d8c87259f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.004873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2bc87871-7937-4de1-81db-515d8c87259f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:20.006083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2bc87871-7937-4de1-81db-515d8c87259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:20.072387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 629/1275] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:20.096627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8e2a-3916-41df-ae0e-052376683e5e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.197448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8e2a-3916-41df-ae0e-052376683e5e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.215114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.232355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.233220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.233505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.233781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.244225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 15:15:20.252089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:20.253213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:20.254318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 647/1276] 10.222.0.87 () {56 vars in 1096 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:20.259575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87871-7937-4de1-81db-515d8c87259f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.340422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.357637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87871-7937-4de1-81db-515d8c87259f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.391232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.391894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.392179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.392457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.393194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:20.393505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.395747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.404250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 630/1277] 10.222.0.87 () {56 vars in 1099 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:20.410055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.510471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245275d-84a5-4ee9-8a90-78dd2848c67a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.544433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.545217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.545495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.545782 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.556923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.558354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:20.575925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:20.576868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:20.577936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:20.577936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:20.577936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:20.577936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:20.577936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 648/1278] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:20.583652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.683659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0447e-bef4-4f04-8e0f-727e5ed2bc5d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.717332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.718051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.718351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.718604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.719347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:20.719693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.721048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.733288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 631/1279] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:15:20.740084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.771689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:20.840184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b168f6-7602-44d0-a556-34339b7eaab6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:20.874382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:20.875219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:20.875506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:20.875865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:20.883599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:20.885049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 15:15:20.900006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:20.901125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:20.902091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 649/1280] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:20.907571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:20.912182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.009001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7680090-20fc-4c40-9941-0b8b202a037a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.042218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.042844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.043128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.043405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.044231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:21.044537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.045954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.063464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 632/1281] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Jul 20 15:15:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:21.070090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.159564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.169389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014b41c-e4fb-4497-814c-e7dd364ccd20 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.202226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.202891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.203178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.203453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.269054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.270737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.357935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.368559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 650/1282] 10.222.0.87 () {58 vars in 1282 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 15:15:21.374501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.436303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.475261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e69702-38c3-4263-a34a-ebc66929c98e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.508139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.508920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.509197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.509464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.520731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.522521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 15:15:21.541205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:21.542271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:21.543437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 15:15:21.543437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 15:15:21.543437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 15:15:21.543437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:21.543437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 633/1283] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:21.548149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.647971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143629b-9ecc-4b2a-ae60-46f711a15173 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.680757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.681407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.681692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.681971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.682713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:21.683022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.684379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.695335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 651/1284] 10.222.0.87 () {56 vars in 1109 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:21.700947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.822340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdfbc1-3bbc-4cca-8701-87374684beb7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:21.836905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.856222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:21.857043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:21.857392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:21.857675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:21.864610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:21.866424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 15:15:21.881105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:21.882100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 20 15:15:21.883143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 634/1285] 10.222.0.87 () {56 vars in 1111 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:21.889015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:21.940064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:21.991721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929cc5e-ec1e-4e1f-af44-75a84e27413e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.031600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79fd80-40ff-44dd-8a21-c85506a05859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.032669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79fd80-40ff-44dd-8a21-c85506a05859 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.033134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79fd80-40ff-44dd-8a21-c85506a05859 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.033575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79fd80-40ff-44dd-8a21-c85506a05859 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.034962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79fd80-40ff-44dd-8a21-c85506a05859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:22.035429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79fd80-40ff-44dd-8a21-c85506a05859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.037215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79fd80-40ff-44dd-8a21-c85506a05859 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.049377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 652/1286] 10.222.0.87 () {56 vars in 1148 bytes} [Wed Jul 20 15:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:22.056159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:22.164115 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579331e-64e6-4255-8ee6-748cb238dfc5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:22.199456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84909356-8704-4fba-a532-a0defc90907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:22.200065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909356-8704-4fba-a532-a0defc90907e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:22.200349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909356-8704-4fba-a532-a0defc90907e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:22.200632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84909356-8704-4fba-a532-a0defc90907e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:22.201467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84909356-8704-4fba-a532-a0defc90907e None admin] RBAC: Adding query filter params (role.id=ce14b9adc23a4229a8205f422f2f8a76, scope.project.id=081b73d4e6644ae189d605f40bae7d94, user.id=c8f8e30141ca4c95b5c11afefbb324c4) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:22.201782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84909356-8704-4fba-a532-a0defc90907e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:22.203262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84909356-8704-4fba-a532-a0defc90907e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:22.209503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 635/1287] 10.222.0.87 () {56 vars in 1374 bytes} [Wed Jul 20 15:15:22 2022] GET /identity/v3/role_assignments?user.id=c8f8e30141ca4c95b5c11afefbb324c4&scope.project.id=081b73d4e6644ae189d605f40bae7d94&role.id=ce14b9adc23a4229a8205f422f2f8a76 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.299843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b784-3f59-4c20-8348-973c73e08bbd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.300470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b784-3f59-4c20-8348-973c73e08bbd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.300470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b784-3f59-4c20-8348-973c73e08bbd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.302547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 653/1288] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:24.307706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494a3d-457a-43fe-bd9d-0436cca04c6c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.308161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494a3d-457a-43fe-bd9d-0436cca04c6c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.308269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494a3d-457a-43fe-bd9d-0436cca04c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.325200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4b494a3d-457a-43fe-bd9d-0436cca04c6c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:24.326368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b494a3d-457a-43fe-bd9d-0436cca04c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:24.355612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.391697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 636/1289] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:24.414016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5b784-3f59-4c20-8348-973c73e08bbd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.516255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5b784-3f59-4c20-8348-973c73e08bbd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.527913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:24.550905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.551615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.551901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.552180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.552831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.554204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:24.565674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:24.568298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:24.569387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 654/1290] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:24.573141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494a3d-457a-43fe-bd9d-0436cca04c6c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.673182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494a3d-457a-43fe-bd9d-0436cca04c6c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.706081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948d79d-5932-4856-91ff-a9f05846f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.707270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948d79d-5932-4856-91ff-a9f05846f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.707571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948d79d-5932-4856-91ff-a9f05846f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.708032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948d79d-5932-4856-91ff-a9f05846f2c7 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.708685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948d79d-5932-4856-91ff-a9f05846f2c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:24.709000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948d79d-5932-4856-91ff-a9f05846f2c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.710363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948d79d-5932-4856-91ff-a9f05846f2c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.715145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 637/1291] 10.222.0.87 () {56 vars in 1116 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:24.720892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:24.821188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd6ef-451e-4caf-9e37-46df239986b0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:24.853531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ecfbd-e149-43b8-9e6e-733bca3939f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:24.854628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ecfbd-e149-43b8-9e6e-733bca3939f4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:24.854628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ecfbd-e149-43b8-9e6e-733bca3939f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:24.854879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ecfbd-e149-43b8-9e6e-733bca3939f4 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:24.855442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ecfbd-e149-43b8-9e6e-733bca3939f4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:24.855750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ecfbd-e149-43b8-9e6e-733bca3939f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:24.857112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ecfbd-e149-43b8-9e6e-733bca3939f4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:24.861444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 655/1292] 10.222.0.87 () {56 vars in 1116 bytes} [Wed Jul 20 15:15:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:26.904260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c30d2-4c0c-4b5c-a3f8-bbb674536c98 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:26.904813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c30d2-4c0c-4b5c-a3f8-bbb674536c98 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:26.904813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c30d2-4c0c-4b5c-a3f8-bbb674536c98 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:26.906208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 638/1293] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:26.912073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c0e3-fcb5-4e83-960e-218f39dabc40 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:26.912506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c0e3-fcb5-4e83-960e-218f39dabc40 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:26.912634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c0e3-fcb5-4e83-960e-218f39dabc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:26.929069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a268c0e3-fcb5-4e83-960e-218f39dabc40 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:26.932271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a268c0e3-fcb5-4e83-960e-218f39dabc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:26.959249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:26.995093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 656/1294] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 15:15:27.018130 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c30d2-4c0c-4b5c-a3f8-bbb674536c98 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:27.049855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:27.119704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c30d2-4c0c-4b5c-a3f8-bbb674536c98 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:27.154724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771d853-1568-4b6a-8038-bec274aec81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:27.155333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771d853-1568-4b6a-8038-bec274aec81e None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:27.155649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771d853-1568-4b6a-8038-bec274aec81e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:27.155931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771d853-1568-4b6a-8038-bec274aec81e None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:27.156652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771d853-1568-4b6a-8038-bec274aec81e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:27.158021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771d853-1568-4b6a-8038-bec274aec81e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:27.240837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 639/1295] 10.222.0.87 () {60 vars in 1141 bytes} [Wed Jul 20 15:15:27 2022] POST /identity/v3/services => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:29.294304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623629d-805d-459a-aed1-b67af7dc72f2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.294906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623629d-805d-459a-aed1-b67af7dc72f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.294906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623629d-805d-459a-aed1-b67af7dc72f2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.296327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 657/1296] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:29.301741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a763-e1dc-4976-b19e-8275a0c54350 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.302146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a763-e1dc-4976-b19e-8275a0c54350 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.302299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a763-e1dc-4976-b19e-8275a0c54350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.319378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c079a763-e1dc-4976-b19e-8275a0c54350 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:29.320506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c079a763-e1dc-4976-b19e-8275a0c54350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:29.395335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 640/1297] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:29.418098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623629d-805d-459a-aed1-b67af7dc72f2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.518792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623629d-805d-459a-aed1-b67af7dc72f2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:29.553593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:29.554398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.554701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.554984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.555635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:29.556994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:29.569038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:29.570255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:29.571494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 658/1298] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:15:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:29.576275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079a763-e1dc-4976-b19e-8275a0c54350 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.595144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:29.676520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079a763-e1dc-4976-b19e-8275a0c54350 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:29.717473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:29.718146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.718428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.718735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.719508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:29.719817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:29.721197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:29.730662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 641/1299] 10.222.0.87 () {56 vars in 1116 bytes} [Wed Jul 20 15:15:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:29.732655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.765603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:29.837015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e507f-8dc5-4785-9eb0-36e62431bed0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:29.872056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6245e-8036-4b1e-8b05-9f93fbf9112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:29.872715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6245e-8036-4b1e-8b05-9f93fbf9112e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:29.872999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6245e-8036-4b1e-8b05-9f93fbf9112e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:29.873273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6245e-8036-4b1e-8b05-9f93fbf9112e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:29.874063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6245e-8036-4b1e-8b05-9f93fbf9112e None admin] RBAC: Adding query filter params (interface=public, service_id=a0ee560aaf174b3e808f3803ab861a88, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:29.874373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6245e-8036-4b1e-8b05-9f93fbf9112e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:29.875775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6245e-8036-4b1e-8b05-9f93fbf9112e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:29.881328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 659/1300] 10.222.0.87 () {56 vars in 1251 bytes} [Wed Jul 20 15:15:29 2022] GET /identity/v3/endpoints?service_id=a0ee560aaf174b3e808f3803ab861a88&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:29.887138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:29.969334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:29.987102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784877-2f6d-4639-a727-3dc6e6284f47 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:30.021429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bb1a1-5e51-4205-a36d-8d53aacacc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:30.022181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bb1a1-5e51-4205-a36d-8d53aacacc98 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:30.022466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bb1a1-5e51-4205-a36d-8d53aacacc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:30.022780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bb1a1-5e51-4205-a36d-8d53aacacc98 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:30.023469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bb1a1-5e51-4205-a36d-8d53aacacc98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:30.024834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bb1a1-5e51-4205-a36d-8d53aacacc98 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:30.031715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 642/1301] 10.222.0.87 () {56 vars in 1087 bytes} [Wed Jul 20 15:15:29 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:15:32.055713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464879-7464-4460-be5c-7ed906b68e64 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.056273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464879-7464-4460-be5c-7ed906b68e64 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.056273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3464879-7464-4460-be5c-7ed906b68e64 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.057637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 660/1302] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:15:32.062849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e0b7-b206-44b7-bc63-db4f1fcffeca None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.063237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e0b7-b206-44b7-bc63-db4f1fcffeca None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.063412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6e0b7-b206-44b7-bc63-db4f1fcffeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.080421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-15f6e0b7-b206-44b7-bc63-db4f1fcffeca None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:15:32.081618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-15f6e0b7-b206-44b7-bc63-db4f1fcffeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:15:32.147655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 643/1303] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:15:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 15:15:32.171301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3464879-7464-4460-be5c-7ed906b68e64 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.272148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.278938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3464879-7464-4460-be5c-7ed906b68e64 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.312007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.312733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.313025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.313303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.313996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.315382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 15:15:32.328528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 15:15:32.329780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 20 15:15:32.330792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 661/1304] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 15:15:32.335962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6e0b7-b206-44b7-bc63-db4f1fcffeca None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.411500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:32.433771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6e0b7-b206-44b7-bc63-db4f1fcffeca None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.465688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d40b70-87bd-40a6-a4bb-71b1195d7d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.466342 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d40b70-87bd-40a6-a4bb-71b1195d7d7d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.466624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d40b70-87bd-40a6-a4bb-71b1195d7d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.466930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d40b70-87bd-40a6-a4bb-71b1195d7d7d None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.467632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d40b70-87bd-40a6-a4bb-71b1195d7d7d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:15:32.467937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d40b70-87bd-40a6-a4bb-71b1195d7d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.469337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d40b70-87bd-40a6-a4bb-71b1195d7d7d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.474998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 644/1305] 10.222.0.87 () {56 vars in 1116 bytes} [Wed Jul 20 15:15:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:15:32.480796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:15:32.581956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f83d64-f5a9-4a53-bd51-79cffe30b126 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:15:32.615252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43310e-906c-430a-98ad-85a6539f85a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:15:32.615899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43310e-906c-430a-98ad-85a6539f85a7 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:15:32.616187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43310e-906c-430a-98ad-85a6539f85a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:15:32.616462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43310e-906c-430a-98ad-85a6539f85a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:15:32.617192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43310e-906c-430a-98ad-85a6539f85a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:15:32.618556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43310e-906c-430a-98ad-85a6539f85a7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:15:32.686389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 662/1306] 10.222.0.87 () {60 vars in 1144 bytes} [Wed Jul 20 15:15:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:15:42.480999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=30 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:15:42.682095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:31.777819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec79d9-5a1e-4c36-8907-577b65b2ffbf None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:31.778355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec79d9-5a1e-4c36-8907-577b65b2ffbf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:31.778355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec79d9-5a1e-4c36-8907-577b65b2ffbf None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:31.785063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed5c29-9f41-47ce-aa4f-e30cdf54aa82 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:31.785519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed5c29-9f41-47ce-aa4f-e30cdf54aa82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:31.785620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed5c29-9f41-47ce-aa4f-e30cdf54aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:31.789486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 645/1307] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:31.875723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-45ed5c29-9f41-47ce-aa4f-e30cdf54aa82 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:31.883202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-45ed5c29-9f41-47ce-aa4f-e30cdf54aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:32.031613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 663/1308] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:21:32.066635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439955c-7d63-4a7b-acb4-7d126aa5d606 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:32.066986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439955c-7d63-4a7b-acb4-7d126aa5d606 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:32.067272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439955c-7d63-4a7b-acb4-7d126aa5d606 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:32.069292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 646/1309] 10.222.0.87 () {54 vars in 965 bytes} [Wed Jul 20 15:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:32.076445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9d61e-eca4-4dc0-9bca-3bccd9288b0c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:32.076808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9d61e-eca4-4dc0-9bca-3bccd9288b0c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:32.077123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9d61e-eca4-4dc0-9bca-3bccd9288b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:32.158321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fce9d61e-eca4-4dc0-9bca-3bccd9288b0c None None] MFA Rules not processed for user `a1c06e34aaac441e8b1a6366cc384524`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:32.159527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fce9d61e-eca4-4dc0-9bca-3bccd9288b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:32.181041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:32.253825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439955c-7d63-4a7b-acb4-7d126aa5d606 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:32.255781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e439955c-7d63-4a7b-acb4-7d126aa5d606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:32.260065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 664/1310] 10.222.0.87 () {58 vars in 1062 bytes} [Wed Jul 20 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:21:32.379935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439955c-7d63-4a7b-acb4-7d126aa5d606 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:32.461937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46907d-200a-4781-8a24-85eea87ded6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:32.462595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46907d-200a-4781-8a24-85eea87ded6c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:32.462909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46907d-200a-4781-8a24-85eea87ded6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:32.463190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46907d-200a-4781-8a24-85eea87ded6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:32.464825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8a46907d-200a-4781-8a24-85eea87ded6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:32.525969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:32.583295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46907d-200a-4781-8a24-85eea87ded6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:32.585516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46907d-200a-4781-8a24-85eea87ded6c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:32.605177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 647/1311] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:21:34.952286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4d76-92cf-44f8-9128-5f0468af98e9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:34.952830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4d76-92cf-44f8-9128-5f0468af98e9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:34.952830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4d76-92cf-44f8-9128-5f0468af98e9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:34.954439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 665/1312] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:34.960088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dfb6d-d16d-459d-961b-be81b1ca7897 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:34.960492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dfb6d-d16d-459d-961b-be81b1ca7897 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:34.960766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dfb6d-d16d-459d-961b-be81b1ca7897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:35.034016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2d5dfb6d-d16d-459d-961b-be81b1ca7897 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:35.035256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2d5dfb6d-d16d-459d-961b-be81b1ca7897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:35.139956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 648/1313] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:35.180207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4d76-92cf-44f8-9128-5f0468af98e9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:35.181827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4aef4d76-92cf-44f8-9128-5f0468af98e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:35.301777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4d76-92cf-44f8-9128-5f0468af98e9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:35.377856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:35.380732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdcb0e-24f9-476b-8a62-5044e36e6e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:35.381382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdcb0e-24f9-476b-8a62-5044e36e6e92 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:35.381664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdcb0e-24f9-476b-8a62-5044e36e6e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:35.381939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdcb0e-24f9-476b-8a62-5044e36e6e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:35.383591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bccdcb0e-24f9-476b-8a62-5044e36e6e92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:35.509352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdcb0e-24f9-476b-8a62-5044e36e6e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:35.510854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdcb0e-24f9-476b-8a62-5044e36e6e92 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:35.531320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 666/1314] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:38.121319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff115d95-4cda-4852-a6f4-f9b8bfbe41d6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:38.121892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff115d95-4cda-4852-a6f4-f9b8bfbe41d6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:38.121892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff115d95-4cda-4852-a6f4-f9b8bfbe41d6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:38.123287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 649/1315] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:38.128476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658219-0463-445a-a085-7d2816ea6613 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:38.128903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658219-0463-445a-a085-7d2816ea6613 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:38.129039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658219-0463-445a-a085-7d2816ea6613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:38.194255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ad658219-0463-445a-a085-7d2816ea6613 None None] MFA Rules not processed for user `cf126c15be35403a9d3ba58ecc49d2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:38.195478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad658219-0463-445a-a085-7d2816ea6613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:38.246662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:38.290897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 667/1316] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:38.331008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff115d95-4cda-4852-a6f4-f9b8bfbe41d6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:38.335049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff115d95-4cda-4852-a6f4-f9b8bfbe41d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:38.345067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:38.437528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff115d95-4cda-4852-a6f4-f9b8bfbe41d6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:38.511278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922b403-7f44-47ad-a281-36d92aa46827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:38.512057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b403-7f44-47ad-a281-36d92aa46827 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:38.512196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b403-7f44-47ad-a281-36d92aa46827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:38.512469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b403-7f44-47ad-a281-36d92aa46827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:38.514104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d922b403-7f44-47ad-a281-36d92aa46827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:38.579123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:38.624666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922b403-7f44-47ad-a281-36d92aa46827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:38.626101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922b403-7f44-47ad-a281-36d92aa46827 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:38.644920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 650/1317] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:41.455465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37e1d-32dc-450c-bd61-78da2569a162 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:41.456011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37e1d-32dc-450c-bd61-78da2569a162 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:41.456011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37e1d-32dc-450c-bd61-78da2569a162 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:41.457405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 668/1318] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:41.463458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7e82f-cbe1-49be-a040-6e9bd3121906 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:41.463878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7e82f-cbe1-49be-a040-6e9bd3121906 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:41.464020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7e82f-cbe1-49be-a040-6e9bd3121906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:41.528244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-97c7e82f-cbe1-49be-a040-6e9bd3121906 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:41.534036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-97c7e82f-cbe1-49be-a040-6e9bd3121906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:41.629914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 651/1319] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:41.671441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf37e1d-32dc-450c-bd61-78da2569a162 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:41.673005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9cf37e1d-32dc-450c-bd61-78da2569a162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:41.776952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf37e1d-32dc-450c-bd61-78da2569a162 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:41.849643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ca242-153c-4322-a9b1-51ea3998a395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:41.850287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca242-153c-4322-a9b1-51ea3998a395 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:41.850571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca242-153c-4322-a9b1-51ea3998a395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:41.850878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ca242-153c-4322-a9b1-51ea3998a395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:41.852504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-009ca242-153c-4322-a9b1-51ea3998a395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:41.859820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:41.962146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ca242-153c-4322-a9b1-51ea3998a395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:41.963650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ca242-153c-4322-a9b1-51ea3998a395 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:41.982142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 669/1320] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:44.971920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b85ef-663b-4646-af87-65a40517d762 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:44.972464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b85ef-663b-4646-af87-65a40517d762 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:44.972464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b85ef-663b-4646-af87-65a40517d762 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:44.973881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 652/1321] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:44.980039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5254-96e9-46d9-98c2-caed5c628084 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:44.980499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5254-96e9-46d9-98c2-caed5c628084 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:44.980598 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5254-96e9-46d9-98c2-caed5c628084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:45.045403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-748c5254-96e9-46d9-98c2-caed5c628084 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:45.046670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-748c5254-96e9-46d9-98c2-caed5c628084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:45.104382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:45.143119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 670/1322] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:45.180664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b85ef-663b-4646-af87-65a40517d762 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:45.182385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b2b85ef-663b-4646-af87-65a40517d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:45.201918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:45.293032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b85ef-663b-4646-af87-65a40517d762 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:45.372526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b474b95-3e73-427a-8491-db9b20fdfa93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:45.373184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474b95-3e73-427a-8491-db9b20fdfa93 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:45.373468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474b95-3e73-427a-8491-db9b20fdfa93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:45.373746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b474b95-3e73-427a-8491-db9b20fdfa93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:45.375463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7b474b95-3e73-427a-8491-db9b20fdfa93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:45.452531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:45.493602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b474b95-3e73-427a-8491-db9b20fdfa93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:45.495332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b474b95-3e73-427a-8491-db9b20fdfa93 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:45.514967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 653/1323] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:47.627514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ddc5-8974-4a90-8d61-7bd7260374d1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:47.628086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ddc5-8974-4a90-8d61-7bd7260374d1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:47.628086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ddc5-8974-4a90-8d61-7bd7260374d1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:47.629431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 671/1324] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:47.635037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a112-f3de-4707-87a3-5788fe94e5e3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:47.635483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a112-f3de-4707-87a3-5788fe94e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:47.635597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333a112-f3de-4707-87a3-5788fe94e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:47.701623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7333a112-f3de-4707-87a3-5788fe94e5e3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:47.702875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7333a112-f3de-4707-87a3-5788fe94e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:47.805654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 654/1325] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:47.842577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ddc5-8974-4a90-8d61-7bd7260374d1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:47.844350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3bd5ddc5-8974-4a90-8d61-7bd7260374d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:47.949707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ddc5-8974-4a90-8d61-7bd7260374d1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:48.023749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa0011-d02a-4435-ab8c-147ffc46e195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:48.024404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0011-d02a-4435-ab8c-147ffc46e195 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:48.024689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0011-d02a-4435-ab8c-147ffc46e195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:48.024966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa0011-d02a-4435-ab8c-147ffc46e195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:48.026588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-59fa0011-d02a-4435-ab8c-147ffc46e195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:48.044063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:48.139196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa0011-d02a-4435-ab8c-147ffc46e195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:48.140680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa0011-d02a-4435-ab8c-147ffc46e195 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:48.162761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 672/1326] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:50.271850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935631-18ce-45a7-a6eb-361299c9b791 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:50.272517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935631-18ce-45a7-a6eb-361299c9b791 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:50.272517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935631-18ce-45a7-a6eb-361299c9b791 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:50.273801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 655/1327] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:50.279149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140a90-d1ab-4753-8338-a5931b25d7a0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:50.279613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140a90-d1ab-4753-8338-a5931b25d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:50.279713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76140a90-d1ab-4753-8338-a5931b25d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:50.350914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-76140a90-d1ab-4753-8338-a5931b25d7a0 None None] MFA Rules not processed for user `cf126c15be35403a9d3ba58ecc49d2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:50.352127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-76140a90-d1ab-4753-8338-a5931b25d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:50.417393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:50.448857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 673/1328] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:50.487113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935631-18ce-45a7-a6eb-361299c9b791 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:50.488643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-35935631-18ce-45a7-a6eb-361299c9b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:50.525421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:50.603861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935631-18ce-45a7-a6eb-361299c9b791 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:50.679516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfbdf5-800f-4a98-ad9d-214275dc6387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:50.680157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfbdf5-800f-4a98-ad9d-214275dc6387 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:50.680440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfbdf5-800f-4a98-ad9d-214275dc6387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:50.680718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfbdf5-800f-4a98-ad9d-214275dc6387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:50.682345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-93dfbdf5-800f-4a98-ad9d-214275dc6387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:50.759457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:50.791342 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfbdf5-800f-4a98-ad9d-214275dc6387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:50.792773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfbdf5-800f-4a98-ad9d-214275dc6387 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:50.812718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 656/1329] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:53.291708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9c50a-0f8b-44e8-8ea1-24b8cbc2dc67 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:53.292227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9c50a-0f8b-44e8-8ea1-24b8cbc2dc67 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:53.292227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9c50a-0f8b-44e8-8ea1-24b8cbc2dc67 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:53.293557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 674/1330] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:53.298830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381a7e-04a9-4f90-a943-4b3a74bf55bf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:53.299268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381a7e-04a9-4f90-a943-4b3a74bf55bf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:53.299392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb381a7e-04a9-4f90-a943-4b3a74bf55bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:53.371565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bb381a7e-04a9-4f90-a943-4b3a74bf55bf None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:53.372790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bb381a7e-04a9-4f90-a943-4b3a74bf55bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:53.469229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 657/1331] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:53.506522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9c50a-0f8b-44e8-8ea1-24b8cbc2dc67 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:53.508082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-84f9c50a-0f8b-44e8-8ea1-24b8cbc2dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:53.618301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9c50a-0f8b-44e8-8ea1-24b8cbc2dc67 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:53.694086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddbdcb-6164-4519-b82e-6fdd3ea5c32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:53.694769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddbdcb-6164-4519-b82e-6fdd3ea5c32e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:53.695060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddbdcb-6164-4519-b82e-6fdd3ea5c32e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:53.695339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddbdcb-6164-4519-b82e-6fdd3ea5c32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:53.697297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d0ddbdcb-6164-4519-b82e-6fdd3ea5c32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:53.727082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:53.808597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddbdcb-6164-4519-b82e-6fdd3ea5c32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:53.809968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddbdcb-6164-4519-b82e-6fdd3ea5c32e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:53.828203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 675/1332] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:55.894793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788c679-e521-40c1-a3d1-1840f7f30d81 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:55.895335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788c679-e521-40c1-a3d1-1840f7f30d81 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:55.895426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788c679-e521-40c1-a3d1-1840f7f30d81 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:55.897131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 658/1333] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:55.902336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fecc53-5305-4a57-ba4f-f936f627b68c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:55.902786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fecc53-5305-4a57-ba4f-f936f627b68c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:55.902947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fecc53-5305-4a57-ba4f-f936f627b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:55.965809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-09fecc53-5305-4a57-ba4f-f936f627b68c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:55.967032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-09fecc53-5305-4a57-ba4f-f936f627b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:56.041163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:56.063517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 676/1334] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:56.105349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788c679-e521-40c1-a3d1-1840f7f30d81 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:56.106927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1788c679-e521-40c1-a3d1-1840f7f30d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:56.146501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:56.209765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788c679-e521-40c1-a3d1-1840f7f30d81 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:56.282867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2a00-cfda-4d0b-8092-4ea8f83b16c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:56.283500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2a00-cfda-4d0b-8092-4ea8f83b16c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:56.283782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2a00-cfda-4d0b-8092-4ea8f83b16c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:56.284055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2a00-cfda-4d0b-8092-4ea8f83b16c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:56.285672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cafa2a00-cfda-4d0b-8092-4ea8f83b16c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:56.367749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:56.392416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa2a00-cfda-4d0b-8092-4ea8f83b16c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:56.393854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa2a00-cfda-4d0b-8092-4ea8f83b16c5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:56.414021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 659/1335] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:21:59.010172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173dc42-50fb-4419-9eda-e91a06007002 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:59.010794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173dc42-50fb-4419-9eda-e91a06007002 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:59.010794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173dc42-50fb-4419-9eda-e91a06007002 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:59.012116 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 677/1336] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:21:59.017368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e5032-66be-450d-ade2-b39f8b85c35c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:59.017820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e5032-66be-450d-ade2-b39f8b85c35c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:59.017928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e5032-66be-450d-ade2-b39f8b85c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:59.093674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ad7e5032-66be-450d-ade2-b39f8b85c35c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:21:59.094928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ad7e5032-66be-450d-ade2-b39f8b85c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:59.189925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 660/1337] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:21:59.227050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173dc42-50fb-4419-9eda-e91a06007002 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:21:59.228564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d173dc42-50fb-4419-9eda-e91a06007002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:59.329906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173dc42-50fb-4419-9eda-e91a06007002 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:21:59.403251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343808e0-19dc-4d4e-8c89-7120efd24280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:21:59.403829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343808e0-19dc-4d4e-8c89-7120efd24280 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:21:59.404117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343808e0-19dc-4d4e-8c89-7120efd24280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:21:59.404394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343808e0-19dc-4d4e-8c89-7120efd24280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:21:59.406041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-343808e0-19dc-4d4e-8c89-7120efd24280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:21:59.441045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:21:59.514631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343808e0-19dc-4d4e-8c89-7120efd24280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:21:59.516090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343808e0-19dc-4d4e-8c89-7120efd24280 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:21:59.536219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 678/1338] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:21:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:03.707713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b185e12-3529-4c43-92e4-909a69db6ed0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:03.708183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b185e12-3529-4c43-92e4-909a69db6ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:03.708311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b185e12-3529-4c43-92e4-909a69db6ed0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:03.710391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 661/1339] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:03.715587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d9f4-07cd-4240-b707-c8a3413f7e51 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:03.716063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d9f4-07cd-4240-b707-c8a3413f7e51 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:03.716159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d9f4-07cd-4240-b707-c8a3413f7e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:03.792528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3a79d9f4-07cd-4240-b707-c8a3413f7e51 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:03.793690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a79d9f4-07cd-4240-b707-c8a3413f7e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:03.888367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:03.900847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 679/1340] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:03.941840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b185e12-3529-4c43-92e4-909a69db6ed0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:03.943509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7b185e12-3529-4c43-92e4-909a69db6ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:03.993937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:04.052515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b185e12-3529-4c43-92e4-909a69db6ed0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:04.126523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b26333-1649-4dd6-986f-24ba9544930b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:04.127219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26333-1649-4dd6-986f-24ba9544930b service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:04.127503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26333-1649-4dd6-986f-24ba9544930b service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:04.127780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b26333-1649-4dd6-986f-24ba9544930b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:04.129417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f5b26333-1649-4dd6-986f-24ba9544930b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:04.225677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:04.241781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b26333-1649-4dd6-986f-24ba9544930b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:04.243276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b26333-1649-4dd6-986f-24ba9544930b service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:04.261604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 662/1341] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:07.299731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bfeca-2740-4d3e-8031-d1a7d0dc3e8e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:07.300268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bfeca-2740-4d3e-8031-d1a7d0dc3e8e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:07.300268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bfeca-2740-4d3e-8031-d1a7d0dc3e8e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:07.301776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 680/1342] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:07.307706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b569ed-1982-405f-8eb0-14bc6feb6c7a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:07.308141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b569ed-1982-405f-8eb0-14bc6feb6c7a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:07.308264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b569ed-1982-405f-8eb0-14bc6feb6c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:07.374014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-56b569ed-1982-405f-8eb0-14bc6feb6c7a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:07.375131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-56b569ed-1982-405f-8eb0-14bc6feb6c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:07.471419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 663/1343] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:07.511194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bfeca-2740-4d3e-8031-d1a7d0dc3e8e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:07.512727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-812bfeca-2740-4d3e-8031-d1a7d0dc3e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:07.618860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bfeca-2740-4d3e-8031-d1a7d0dc3e8e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:07.693774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4796a2f-799b-4708-8f3d-2571babfaffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:07.694336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4796a2f-799b-4708-8f3d-2571babfaffb service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:07.694701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4796a2f-799b-4708-8f3d-2571babfaffb service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:07.694958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4796a2f-799b-4708-8f3d-2571babfaffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:07.696605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d4796a2f-799b-4708-8f3d-2571babfaffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:07.742147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:07.815221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4796a2f-799b-4708-8f3d-2571babfaffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:07.816667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4796a2f-799b-4708-8f3d-2571babfaffb service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:07.837211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 681/1344] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:12.159359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8153-91de-4198-a401-d9d97af271e7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:12.159875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8153-91de-4198-a401-d9d97af271e7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:12.159983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8153-91de-4198-a401-d9d97af271e7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:12.161320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 664/1345] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:12.167928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d09c6-e1ff-422b-947d-bd79c750e0cd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:12.168417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d09c6-e1ff-422b-947d-bd79c750e0cd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:12.168522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d09c6-e1ff-422b-947d-bd79c750e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:12.239227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-511d09c6-e1ff-422b-947d-bd79c750e0cd None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:12.240505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-511d09c6-e1ff-422b-947d-bd79c750e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:12.339216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:12.342240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 682/1346] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:12.381217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf8153-91de-4198-a401-d9d97af271e7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:12.382945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-00bf8153-91de-4198-a401-d9d97af271e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:12.443557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:12.506954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf8153-91de-4198-a401-d9d97af271e7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:12.583742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480b97a-e06b-4594-b5b8-7fc3dd6bb1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:12.584422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480b97a-e06b-4594-b5b8-7fc3dd6bb1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:12.584881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480b97a-e06b-4594-b5b8-7fc3dd6bb1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:12.585164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480b97a-e06b-4594-b5b8-7fc3dd6bb1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:12.586876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2480b97a-e06b-4594-b5b8-7fc3dd6bb1d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:12.691009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:12.694192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480b97a-e06b-4594-b5b8-7fc3dd6bb1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:12.695652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480b97a-e06b-4594-b5b8-7fc3dd6bb1d7 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:12.713195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 665/1347] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:17.732027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541477a5-9cf3-4376-8612-28d02c781ae7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:17.733091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541477a5-9cf3-4376-8612-28d02c781ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:17.733579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541477a5-9cf3-4376-8612-28d02c781ae7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:17.735857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 683/1348] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:22:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:17.741726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d500-1d0e-40ff-8332-49b621c9e656 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:17.742172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d500-1d0e-40ff-8332-49b621c9e656 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:17.742269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3d500-1d0e-40ff-8332-49b621c9e656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:17.843522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f6d3d500-1d0e-40ff-8332-49b621c9e656 None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:17.845234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f6d3d500-1d0e-40ff-8332-49b621c9e656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:18.050735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 666/1349] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:21.921997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb3d6-4272-4326-8985-0a52247ea01e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:21.922594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb3d6-4272-4326-8985-0a52247ea01e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:21.922594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cb3d6-4272-4326-8985-0a52247ea01e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:21.924146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 684/1350] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:21.929052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3f036-8f64-430d-aefe-c87eb649ad3c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:21.929478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3f036-8f64-430d-aefe-c87eb649ad3c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:21.929620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3f036-8f64-430d-aefe-c87eb649ad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:21.984650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:22.008224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-34f3f036-8f64-430d-aefe-c87eb649ad3c None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:22.009477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-34f3f036-8f64-430d-aefe-c87eb649ad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:22.124383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 667/1351] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:23.508720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5892-634a-48fa-ba86-a4b8833fabf5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:23.509259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5892-634a-48fa-ba86-a4b8833fabf5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:23.509259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb5892-634a-48fa-ba86-a4b8833fabf5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:23.510878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 685/1352] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:23.516049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a60c-cb8d-4177-ad4e-fe30d10645e0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:23.516508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a60c-cb8d-4177-ad4e-fe30d10645e0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:23.516803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a60c-cb8d-4177-ad4e-fe30d10645e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:23.595375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6443a60c-cb8d-4177-ad4e-fe30d10645e0 None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:23.596563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6443a60c-cb8d-4177-ad4e-fe30d10645e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:23.639297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:23.707011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 668/1353] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:27.378273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302297-d3ae-43db-ad02-66c884318927 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:27.378822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302297-d3ae-43db-ad02-66c884318927 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:27.378905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302297-d3ae-43db-ad02-66c884318927 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:27.380275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 686/1354] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:27.386221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822334-322c-473f-8c2d-827dc6d557ce None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:27.387360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822334-322c-473f-8c2d-827dc6d557ce None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:27.388221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf822334-322c-473f-8c2d-827dc6d557ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:27.457810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cf822334-322c-473f-8c2d-827dc6d557ce None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:27.459180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cf822334-322c-473f-8c2d-827dc6d557ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:27.573909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 669/1355] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:27.631755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0c55-3b9a-469a-9c17-6d26537dd556 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:27.632363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0c55-3b9a-469a-9c17-6d26537dd556 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:27.632970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0c55-3b9a-469a-9c17-6d26537dd556 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:27.634558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 687/1356] 10.222.0.87 () {54 vars in 962 bytes} [Wed Jul 20 15:22:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:27.643787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2789a1-e3a4-4dc8-912f-5c3a006f26fa None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:27.644680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2789a1-e3a4-4dc8-912f-5c3a006f26fa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:27.645419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2789a1-e3a4-4dc8-912f-5c3a006f26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:27.664242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:27.731632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-da2789a1-e3a4-4dc8-912f-5c3a006f26fa None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:27.732786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-da2789a1-e3a4-4dc8-912f-5c3a006f26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:27.856570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 670/1357] 10.222.0.87 () {58 vars in 1059 bytes} [Wed Jul 20 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:22:27.865195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0c55-3b9a-469a-9c17-6d26537dd556 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:27.866991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-623d0c55-3b9a-469a-9c17-6d26537dd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:28.020819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0c55-3b9a-469a-9c17-6d26537dd556 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:28.101934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:28.142588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bcabe-9247-44d4-a11d-51f49aafe48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:28.143308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bcabe-9247-44d4-a11d-51f49aafe48e service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:28.143597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bcabe-9247-44d4-a11d-51f49aafe48e service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:28.143878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bcabe-9247-44d4-a11d-51f49aafe48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:28.145518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aa5bcabe-9247-44d4-a11d-51f49aafe48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:28.244545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bcabe-9247-44d4-a11d-51f49aafe48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:28.246151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bcabe-9247-44d4-a11d-51f49aafe48e service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:28.274889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 688/1358] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:30.552128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c424a2-7085-4311-9861-afe1c6739d4b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:30.552128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c424a2-7085-4311-9861-afe1c6739d4b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:30.552128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c424a2-7085-4311-9861-afe1c6739d4b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:30.554196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 671/1359] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:30.560051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89eb35-cec3-4153-97a1-a012ca1ea3e9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:30.560529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89eb35-cec3-4153-97a1-a012ca1ea3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:30.560796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89eb35-cec3-4153-97a1-a012ca1ea3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:30.629844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6b89eb35-cec3-4153-97a1-a012ca1ea3e9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:30.631240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6b89eb35-cec3-4153-97a1-a012ca1ea3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:30.671581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:30.738452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 689/1360] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:22:30.784501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c424a2-7085-4311-9861-afe1c6739d4b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:30.786061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c7c424a2-7085-4311-9861-afe1c6739d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:30.857494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:30.959418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c424a2-7085-4311-9861-afe1c6739d4b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:31.095805 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c60e-a147-4932-9f05-e8b8243b4f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:31.096457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c60e-a147-4932-9f05-e8b8243b4f62 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:31.096743 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c60e-a147-4932-9f05-e8b8243b4f62 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:31.097018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c60e-a147-4932-9f05-e8b8243b4f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:31.098669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0003c60e-a147-4932-9f05-e8b8243b4f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:31.127732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:31.204340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c60e-a147-4932-9f05-e8b8243b4f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:31.206050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c60e-a147-4932-9f05-e8b8243b4f62 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:31.226752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 672/1361] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:33.773440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dadaa6-1e1e-4c05-8d0e-124392d43709 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:33.774422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dadaa6-1e1e-4c05-8d0e-124392d43709 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:33.774992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dadaa6-1e1e-4c05-8d0e-124392d43709 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:33.776604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 690/1362] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:22:33.782050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6198f-ad7e-41a0-8d4d-887b2a56a140 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:33.782929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6198f-ad7e-41a0-8d4d-887b2a56a140 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:33.783425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6198f-ad7e-41a0-8d4d-887b2a56a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:33.854028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-60a6198f-ad7e-41a0-8d4d-887b2a56a140 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:33.855280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-60a6198f-ad7e-41a0-8d4d-887b2a56a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:33.978977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:33.982576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 673/1363] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:34.029866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915979f-f8b1-4949-a89c-938d6d9e19ac None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:34.030373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915979f-f8b1-4949-a89c-938d6d9e19ac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:34.030856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915979f-f8b1-4949-a89c-938d6d9e19ac None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:34.032691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 691/1364] 10.222.0.87 () {54 vars in 962 bytes} [Wed Jul 20 15:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:34.038759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d411-d218-42ec-976e-9314b0f751e5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:34.039093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d411-d218-42ec-976e-9314b0f751e5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:34.039331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4d411-d218-42ec-976e-9314b0f751e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:34.123005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d1c4d411-d218-42ec-976e-9314b0f751e5 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:34.124298 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d1c4d411-d218-42ec-976e-9314b0f751e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:34.249493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 674/1365] 10.222.0.87 () {58 vars in 1059 bytes} [Wed Jul 20 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:34.257777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915979f-f8b1-4949-a89c-938d6d9e19ac None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:34.259413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d915979f-f8b1-4949-a89c-938d6d9e19ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:34.423201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915979f-f8b1-4949-a89c-938d6d9e19ac None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:34.445464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:34.551104 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a3da0-5a5f-4820-a701-f32d08967c38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:34.551759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3da0-5a5f-4820-a701-f32d08967c38 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:34.552041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3da0-5a5f-4820-a701-f32d08967c38 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:34.552380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a3da0-5a5f-4820-a701-f32d08967c38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:34.554732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9f7a3da0-5a5f-4820-a701-f32d08967c38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:34.657881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a3da0-5a5f-4820-a701-f32d08967c38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:34.659533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a3da0-5a5f-4820-a701-f32d08967c38 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:34.679706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 692/1366] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:35.577252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581914e-04b2-429f-a25e-79b8fbed0b8f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:35.579917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581914e-04b2-429f-a25e-79b8fbed0b8f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:35.579917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581914e-04b2-429f-a25e-79b8fbed0b8f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:35.579917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 675/1367] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:35.585082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea4da-a1b6-44d1-a912-e769f8dd32f7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:35.585498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea4da-a1b6-44d1-a912-e769f8dd32f7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:35.585683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adea4da-a1b6-44d1-a912-e769f8dd32f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:35.617841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:35.656354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5adea4da-a1b6-44d1-a912-e769f8dd32f7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:35.657709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5adea4da-a1b6-44d1-a912-e769f8dd32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:35.762784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 693/1368] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:36.103353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eee4c-01a5-47f3-96f8-9b11de4b7603 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:36.103849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eee4c-01a5-47f3-96f8-9b11de4b7603 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:36.104228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725eee4c-01a5-47f3-96f8-9b11de4b7603 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:36.106074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 676/1369] 10.222.0.87 () {54 vars in 964 bytes} [Wed Jul 20 15:22:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:36.111296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a45b48-9e88-490a-9c2a-2015b604587f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:36.111593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a45b48-9e88-490a-9c2a-2015b604587f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:36.111874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a45b48-9e88-490a-9c2a-2015b604587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:36.189704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-04a45b48-9e88-490a-9c2a-2015b604587f None None] MFA Rules not processed for user `1e49a95b86044f5aa9ff4a084ee8cee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:36.190949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-04a45b48-9e88-490a-9c2a-2015b604587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:36.239719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:36.269441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 694/1370] 10.222.0.87 () {58 vars in 1061 bytes} [Wed Jul 20 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:36.277629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eee4c-01a5-47f3-96f8-9b11de4b7603 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:36.279483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-725eee4c-01a5-47f3-96f8-9b11de4b7603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:36.337794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:36.394093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725eee4c-01a5-47f3-96f8-9b11de4b7603 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:36.472321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2e00b-4352-4725-a4b6-96eb429d98fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:36.473033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2e00b-4352-4725-a4b6-96eb429d98fe service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:36.473325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2e00b-4352-4725-a4b6-96eb429d98fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:36.473605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2e00b-4352-4725-a4b6-96eb429d98fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:36.475836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-73d2e00b-4352-4725-a4b6-96eb429d98fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:36.593518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:36.607184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2e00b-4352-4725-a4b6-96eb429d98fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:36.608741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2e00b-4352-4725-a4b6-96eb429d98fe service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:36.626735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 677/1371] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:36.973815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a1dd-323b-4cf4-892b-96335440971d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:36.974295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a1dd-323b-4cf4-892b-96335440971d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:36.974716 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20a1dd-323b-4cf4-892b-96335440971d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:36.976475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 695/1372] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:36.981870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe34c-da12-4786-9e50-639758c87bc9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:36.982158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe34c-da12-4786-9e50-639758c87bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:36.983037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efe34c-da12-4786-9e50-639758c87bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:37.054954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-19efe34c-da12-4786-9e50-639758c87bc9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:37.056183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-19efe34c-da12-4786-9e50-639758c87bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:37.153923 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 678/1373] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:37.199815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20a1dd-323b-4cf4-892b-96335440971d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:37.201432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a20a1dd-323b-4cf4-892b-96335440971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:37.352204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20a1dd-323b-4cf4-892b-96335440971d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:37.404799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:37.469604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489f1c3-1838-49ad-99f2-124d3ffffd53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:37.470266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489f1c3-1838-49ad-99f2-124d3ffffd53 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:37.470553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489f1c3-1838-49ad-99f2-124d3ffffd53 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:37.470864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489f1c3-1838-49ad-99f2-124d3ffffd53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:37.472507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d489f1c3-1838-49ad-99f2-124d3ffffd53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:37.566884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489f1c3-1838-49ad-99f2-124d3ffffd53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:37.568524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489f1c3-1838-49ad-99f2-124d3ffffd53 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:37.587282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 696/1374] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:39.783518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a025adb-bd1a-445e-bce8-50d9ab7028be None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:39.784013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a025adb-bd1a-445e-bce8-50d9ab7028be None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:39.784013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a025adb-bd1a-445e-bce8-50d9ab7028be None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:39.785413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 679/1375] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:39.791515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265bb8-0ab7-4abf-8f49-2c896a51c69c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:39.791956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265bb8-0ab7-4abf-8f49-2c896a51c69c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:39.792190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265bb8-0ab7-4abf-8f49-2c896a51c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:39.855949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d2265bb8-0ab7-4abf-8f49-2c896a51c69c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:39.857142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d2265bb8-0ab7-4abf-8f49-2c896a51c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:39.863710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:39.956896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 697/1376] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:22:40.004403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a025adb-bd1a-445e-bce8-50d9ab7028be None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:40.006452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6a025adb-bd1a-445e-bce8-50d9ab7028be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:40.069450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:40.162815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a025adb-bd1a-445e-bce8-50d9ab7028be None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:40.314869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd754202-de35-43b5-a41e-53d461d88091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:40.315673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754202-de35-43b5-a41e-53d461d88091 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:40.316065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754202-de35-43b5-a41e-53d461d88091 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:40.316437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754202-de35-43b5-a41e-53d461d88091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:40.318426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bd754202-de35-43b5-a41e-53d461d88091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:40.340494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:40.414722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd754202-de35-43b5-a41e-53d461d88091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:40.416445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd754202-de35-43b5-a41e-53d461d88091 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:40.436259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 680/1377] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:42.635249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172dd0b-2c81-4cc0-9cbb-5430e03bb21d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:42.635886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172dd0b-2c81-4cc0-9cbb-5430e03bb21d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:42.635886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172dd0b-2c81-4cc0-9cbb-5430e03bb21d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:42.637346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 698/1378] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:42.642563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3912-64bc-40b8-87a3-161203cdc542 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:42.643235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3912-64bc-40b8-87a3-161203cdc542 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:42.643235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d3912-64bc-40b8-87a3-161203cdc542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:42.712486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-404d3912-64bc-40b8-87a3-161203cdc542 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:42.713705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-404d3912-64bc-40b8-87a3-161203cdc542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:42.810408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:42.816596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 681/1379] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:42.861586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172dd0b-2c81-4cc0-9cbb-5430e03bb21d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:42.863319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3172dd0b-2c81-4cc0-9cbb-5430e03bb21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:43.017006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:43.028498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172dd0b-2c81-4cc0-9cbb-5430e03bb21d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:43.163199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0402a79-0127-4655-ae5c-b5596a984d6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:43.163870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0402a79-0127-4655-ae5c-b5596a984d6f service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:43.164154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0402a79-0127-4655-ae5c-b5596a984d6f service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:43.164437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0402a79-0127-4655-ae5c-b5596a984d6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:43.166084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a0402a79-0127-4655-ae5c-b5596a984d6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:43.268756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0402a79-0127-4655-ae5c-b5596a984d6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:43.270516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0402a79-0127-4655-ae5c-b5596a984d6f service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:43.282271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:43.292269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 699/1380] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:45.787603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482abc3f-af80-4fd3-9d4b-92f784f68c79 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:45.788125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482abc3f-af80-4fd3-9d4b-92f784f68c79 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:45.788372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482abc3f-af80-4fd3-9d4b-92f784f68c79 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:45.790156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 682/1381] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:45.796668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0564b1-a2c2-4ede-977f-9865c00b2ad1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:45.797125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0564b1-a2c2-4ede-977f-9865c00b2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:45.797277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0564b1-a2c2-4ede-977f-9865c00b2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:45.866739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1f0564b1-a2c2-4ede-977f-9865c00b2ad1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:45.868051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1f0564b1-a2c2-4ede-977f-9865c00b2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:45.976176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 700/1382] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:46.020553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482abc3f-af80-4fd3-9d4b-92f784f68c79 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:46.023677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-482abc3f-af80-4fd3-9d4b-92f784f68c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:46.174043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482abc3f-af80-4fd3-9d4b-92f784f68c79 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:46.252222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:46.300258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515de5-52fc-4556-b440-a5eb7dd7d48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:46.300938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515de5-52fc-4556-b440-a5eb7dd7d48c service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:46.301235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515de5-52fc-4556-b440-a5eb7dd7d48c service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:46.301527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515de5-52fc-4556-b440-a5eb7dd7d48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:46.304456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-34515de5-52fc-4556-b440-a5eb7dd7d48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:46.409155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34515de5-52fc-4556-b440-a5eb7dd7d48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:46.410900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34515de5-52fc-4556-b440-a5eb7dd7d48c service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:46.431547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 683/1383] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:48.959964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c68e-6730-4e39-a68e-82959f471a04 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:48.960535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c68e-6730-4e39-a68e-82959f471a04 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:48.960535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44c68e-6730-4e39-a68e-82959f471a04 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:48.961917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 701/1384] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:48.968311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a3a5-d0d3-4b0c-b903-43b1b5219b43 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:48.968776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a3a5-d0d3-4b0c-b903-43b1b5219b43 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:48.968900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a3a5-d0d3-4b0c-b903-43b1b5219b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:49.072590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a605a3a5-d0d3-4b0c-b903-43b1b5219b43 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:49.075247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a605a3a5-d0d3-4b0c-b903-43b1b5219b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:49.138659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:49.214749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 684/1385] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:49.260592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c68e-6730-4e39-a68e-82959f471a04 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:49.262164 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f44c68e-6730-4e39-a68e-82959f471a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:49.345613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:49.418699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44c68e-6730-4e39-a68e-82959f471a04 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:49.551047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce5276-aad1-4b03-8858-9efb624ccec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:49.551705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5276-aad1-4b03-8858-9efb624ccec4 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:49.551991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5276-aad1-4b03-8858-9efb624ccec4 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:49.552906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5276-aad1-4b03-8858-9efb624ccec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:49.554552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27ce5276-aad1-4b03-8858-9efb624ccec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:49.602777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:49.659869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce5276-aad1-4b03-8858-9efb624ccec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:49.662410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce5276-aad1-4b03-8858-9efb624ccec4 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:49.682836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 702/1386] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:51.987222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1920200-39c9-4566-b018-bd120b1c6f51 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:51.987823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1920200-39c9-4566-b018-bd120b1c6f51 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:51.987823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1920200-39c9-4566-b018-bd120b1c6f51 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:51.989165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 685/1387] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:51.995003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86be13-3a70-499c-b946-12540fc4c8c4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:51.995453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86be13-3a70-499c-b946-12540fc4c8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:51.995585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86be13-3a70-499c-b946-12540fc4c8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.061628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bd86be13-3a70-499c-b946-12540fc4c8c4 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:52.062868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd86be13-3a70-499c-b946-12540fc4c8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:52.158577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 703/1388] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:52.160321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b981d-cf3c-4e7a-8ce7-1cd01aab0210 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.160611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b981d-cf3c-4e7a-8ce7-1cd01aab0210 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.160893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b981d-cf3c-4e7a-8ce7-1cd01aab0210 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.162863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 686/1389] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:52.167924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e77c-67c7-4cd6-a1d8-df66e5b4114d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.168237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e77c-67c7-4cd6-a1d8-df66e5b4114d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.168518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e77c-67c7-4cd6-a1d8-df66e5b4114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.182693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:52.203679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b981d-cf3c-4e7a-8ce7-1cd01aab0210 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:52.205173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-158b981d-cf3c-4e7a-8ce7-1cd01aab0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:52.234401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d6a0e77c-67c7-4cd6-a1d8-df66e5b4114d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:52.235645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d6a0e77c-67c7-4cd6-a1d8-df66e5b4114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:52.335810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 704/1390] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:22:52.357278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b981d-cf3c-4e7a-8ce7-1cd01aab0210 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:52.375113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:52.393302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c3f3-f519-4272-a94c-99ce767a660e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.393701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c3f3-f519-4272-a94c-99ce767a660e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.393984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191c3f3-f519-4272-a94c-99ce767a660e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.395410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 705/1391] 10.222.0.87 () {54 vars in 966 bytes} [Wed Jul 20 15:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:22:52.400865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd065ec5-2af4-4d93-b012-93d6c73b19b4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.401165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd065ec5-2af4-4d93-b012-93d6c73b19b4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.401456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd065ec5-2af4-4d93-b012-93d6c73b19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.476900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d5348-2b13-4a65-a92d-53edaa9b8066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:52.477552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5348-2b13-4a65-a92d-53edaa9b8066 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.477833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5348-2b13-4a65-a92d-53edaa9b8066 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.478110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5348-2b13-4a65-a92d-53edaa9b8066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.479503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cd065ec5-2af4-4d93-b012-93d6c73b19b4 None None] MFA Rules not processed for user `5d166e2866794925bd5bde02040239dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:52.479773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aa6d5348-2b13-4a65-a92d-53edaa9b8066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:52.480684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cd065ec5-2af4-4d93-b012-93d6c73b19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:52.516576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:52.563819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 706/1392] 10.222.0.87 () {58 vars in 1063 bytes} [Wed Jul 20 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:22:52.571646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd065ec5-2af4-4d93-b012-93d6c73b19b4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:52.577384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d5348-2b13-4a65-a92d-53edaa9b8066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:52.579024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d5348-2b13-4a65-a92d-53edaa9b8066 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:52.579227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd065ec5-2af4-4d93-b012-93d6c73b19b4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:52.598394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 687/1393] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:22:52.656308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63072d-7177-4fa5-ade7-769c62430ea7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:52.656960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63072d-7177-4fa5-ade7-769c62430ea7 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:52.657248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63072d-7177-4fa5-ade7-769c62430ea7 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:52.657588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63072d-7177-4fa5-ade7-769c62430ea7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:52.659247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3f63072d-7177-4fa5-ade7-769c62430ea7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:52.768941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:52.773255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63072d-7177-4fa5-ade7-769c62430ea7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:52.774775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63072d-7177-4fa5-ade7-769c62430ea7 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:52.797271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 707/1394] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:22:53.648494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b4cec-99c4-4e49-9ec3-51c669908663 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:53.649355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b4cec-99c4-4e49-9ec3-51c669908663 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:53.649718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b4cec-99c4-4e49-9ec3-51c669908663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:53.674799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:53.716840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-266b4cec-99c4-4e49-9ec3-51c669908663 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:53.718076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-266b4cec-99c4-4e49-9ec3-51c669908663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:53.807889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 688/1395] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:53.857885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d74b05-532d-43af-85b0-28c0e48af8b8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:53.858407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d74b05-532d-43af-85b0-28c0e48af8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:53.858587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d74b05-532d-43af-85b0-28c0e48af8b8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:53.860122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 708/1396] 10.222.0.87 () {54 vars in 943 bytes} [Wed Jul 20 15:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:53.867027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef72f-9f9c-421c-9924-012941ddd8a2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:53.867459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef72f-9f9c-421c-9924-012941ddd8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:53.867804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef72f-9f9c-421c-9924-012941ddd8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:53.944944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-05fef72f-9f9c-421c-9924-012941ddd8a2 None None] MFA Rules not processed for user `ab1ffde1b21246acb7092df7616e2a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:53.946171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-05fef72f-9f9c-421c-9924-012941ddd8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:53.998575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:54.053971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 689/1397] 10.222.0.87 () {58 vars in 1040 bytes} [Wed Jul 20 15:22:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:54.063300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d74b05-532d-43af-85b0-28c0e48af8b8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:54.064848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-46d74b05-532d-43af-85b0-28c0e48af8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:54.199583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d74b05-532d-43af-85b0-28c0e48af8b8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:54.268795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:54.303336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a590e-6f98-42d2-b852-3ac3044a0dc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:54.303986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a590e-6f98-42d2-b852-3ac3044a0dc6 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:54.304266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a590e-6f98-42d2-b852-3ac3044a0dc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:54.304543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a590e-6f98-42d2-b852-3ac3044a0dc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:54.306206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-563a590e-6f98-42d2-b852-3ac3044a0dc6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:54.391353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a590e-6f98-42d2-b852-3ac3044a0dc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:54.392941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a590e-6f98-42d2-b852-3ac3044a0dc6 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:54.402257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 709/1398] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:22:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:22:54.778726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60acc6-94f6-4881-acf8-0441be4ff159 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:54.779257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60acc6-94f6-4881-acf8-0441be4ff159 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:54.779368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60acc6-94f6-4881-acf8-0441be4ff159 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:54.780676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 690/1399] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:22:54.785922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236031a-71a8-4a41-930c-80f004945e65 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:54.786222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236031a-71a8-4a41-930c-80f004945e65 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:54.786537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236031a-71a8-4a41-930c-80f004945e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:54.855664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4236031a-71a8-4a41-930c-80f004945e65 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:54.856945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4236031a-71a8-4a41-930c-80f004945e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:54.917375 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:54.974831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 710/1400] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:55.013369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60acc6-94f6-4881-acf8-0441be4ff159 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:55.015164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7b60acc6-94f6-4881-acf8-0441be4ff159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:55.182532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60acc6-94f6-4881-acf8-0441be4ff159 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:55.228185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:55.327142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be53462-dac3-4921-9d21-6a3e7638bd96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:55.327800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be53462-dac3-4921-9d21-6a3e7638bd96 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:55.328090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be53462-dac3-4921-9d21-6a3e7638bd96 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:55.328372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be53462-dac3-4921-9d21-6a3e7638bd96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:55.330725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1be53462-dac3-4921-9d21-6a3e7638bd96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:55.434042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be53462-dac3-4921-9d21-6a3e7638bd96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:55.435733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be53462-dac3-4921-9d21-6a3e7638bd96 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:55.454462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 691/1401] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:22:57.713693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd66d-9363-43e6-bab4-7b5168ccce4a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:57.714664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd66d-9363-43e6-bab4-7b5168ccce4a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:57.716618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd66d-9363-43e6-bab4-7b5168ccce4a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:57.716936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 711/1402] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:22:57.722361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f60d6-6f9e-483f-97da-5196ac6d3b7f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:57.723494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f60d6-6f9e-483f-97da-5196ac6d3b7f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:57.725957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f60d6-6f9e-483f-97da-5196ac6d3b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:57.778432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:57.811300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-510f60d6-6f9e-483f-97da-5196ac6d3b7f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:22:57.812551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-510f60d6-6f9e-483f-97da-5196ac6d3b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:57.956383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 692/1403] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:22:58.011533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd66d-9363-43e6-bab4-7b5168ccce4a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:22:58.013169 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da3cd66d-9363-43e6-bab4-7b5168ccce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:58.244566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd66d-9363-43e6-bab4-7b5168ccce4a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:22:58.295537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:22:58.386917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0546f-c418-4581-a553-2b9da9f84111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:22:58.388436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0546f-c418-4581-a553-2b9da9f84111 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:22:58.388901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0546f-c418-4581-a553-2b9da9f84111 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:22:58.389240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0546f-c418-4581-a553-2b9da9f84111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:22:58.391089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8df0546f-c418-4581-a553-2b9da9f84111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:22:58.497336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0546f-c418-4581-a553-2b9da9f84111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:22:58.499020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0546f-c418-4581-a553-2b9da9f84111 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:22:58.525457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 712/1404] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:00.763122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e363e-a3b6-4b2d-9e99-90ea14287cbc None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:00.763122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e363e-a3b6-4b2d-9e99-90ea14287cbc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:00.763122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e363e-a3b6-4b2d-9e99-90ea14287cbc None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:00.764415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 693/1405] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:00.770041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa2c3-4dd5-454e-a86c-c6b9eccec0f3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:00.770463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa2c3-4dd5-454e-a86c-c6b9eccec0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:00.771402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fa2c3-4dd5-454e-a86c-c6b9eccec0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:00.959999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:00.967927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-127fa2c3-4dd5-454e-a86c-c6b9eccec0f3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:00.973794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-127fa2c3-4dd5-454e-a86c-c6b9eccec0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:01.084248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 713/1406] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:01.129510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e363e-a3b6-4b2d-9e99-90ea14287cbc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:01.133611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f87e363e-a3b6-4b2d-9e99-90ea14287cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:01.241799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:01.292366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e363e-a3b6-4b2d-9e99-90ea14287cbc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:01.415749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1a097-cf94-44e8-9b4c-30ccd883c736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:01.416306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a097-cf94-44e8-9b4c-30ccd883c736 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:01.416587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a097-cf94-44e8-9b4c-30ccd883c736 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:01.416860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1a097-cf94-44e8-9b4c-30ccd883c736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:01.418479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ab1a097-cf94-44e8-9b4c-30ccd883c736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:01.499682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:01.525682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1a097-cf94-44e8-9b4c-30ccd883c736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:01.527802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1a097-cf94-44e8-9b4c-30ccd883c736 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:01.549361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 694/1407] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:11.081898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=44 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:11.545814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=14 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:17.975499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa900-105f-4206-82b2-7a57b93a8aa1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:17.976082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa900-105f-4206-82b2-7a57b93a8aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:17.976082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa900-105f-4206-82b2-7a57b93a8aa1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:17.977404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 714/1408] 10.222.0.87 () {54 vars in 918 bytes} [Wed Jul 20 15:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:17.982513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be45a-8452-4eeb-942c-e4ca57807239 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:17.982993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be45a-8452-4eeb-942c-e4ca57807239 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:17.983125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be45a-8452-4eeb-942c-e4ca57807239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:18.058887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c54be45a-8452-4eeb-942c-e4ca57807239 None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:18.060105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c54be45a-8452-4eeb-942c-e4ca57807239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:18.164789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 695/1409] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Jul 20 15:23:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:18.179714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3454b0-bc29-4acc-b924-e936f26b3e1b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:18.180007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3454b0-bc29-4acc-b924-e936f26b3e1b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:18.180311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3454b0-bc29-4acc-b924-e936f26b3e1b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:18.181731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 715/1410] 10.222.0.87 () {54 vars in 918 bytes} [Wed Jul 20 15:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:18.186436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05015-d2d8-40b2-b937-ac15ac1e2761 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:18.186767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05015-d2d8-40b2-b937-ac15ac1e2761 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:18.187052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05015-d2d8-40b2-b937-ac15ac1e2761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:18.257916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:18.260476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-74c05015-d2d8-40b2-b937-ac15ac1e2761 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:18.261682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-74c05015-d2d8-40b2-b937-ac15ac1e2761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:18.377227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 696/1411] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Jul 20 15:23:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:20.881307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12524-1fb8-4314-a9a0-de3d8ab01a69 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:20.881866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12524-1fb8-4314-a9a0-de3d8ab01a69 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:20.881866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b12524-1fb8-4314-a9a0-de3d8ab01a69 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:20.883263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 716/1412] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:20.888521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2570f-8d4c-431f-887d-43ffe15465ec None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:20.888966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2570f-8d4c-431f-887d-43ffe15465ec None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:20.889076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2570f-8d4c-431f-887d-43ffe15465ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:20.953197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-29e2570f-8d4c-431f-887d-43ffe15465ec None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:20.954399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-29e2570f-8d4c-431f-887d-43ffe15465ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:21.008504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:21.050830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 697/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:21.093708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b12524-1fb8-4314-a9a0-de3d8ab01a69 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:21.095320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-43b12524-1fb8-4314-a9a0-de3d8ab01a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:21.240660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b12524-1fb8-4314-a9a0-de3d8ab01a69 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:21.311787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:21.351778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb644e8-ee9d-46f0-ad27-6b6d8f4436dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:21.352430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb644e8-ee9d-46f0-ad27-6b6d8f4436dd service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:21.352711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb644e8-ee9d-46f0-ad27-6b6d8f4436dd service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:21.352985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb644e8-ee9d-46f0-ad27-6b6d8f4436dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:21.354619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3fb644e8-ee9d-46f0-ad27-6b6d8f4436dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:21.442207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb644e8-ee9d-46f0-ad27-6b6d8f4436dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:21.443853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb644e8-ee9d-46f0-ad27-6b6d8f4436dd service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:21.461893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 717/1414] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:22.372737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ba37-0893-4d1e-a4da-6919d2f73d2a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:22.373294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ba37-0893-4d1e-a4da-6919d2f73d2a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:22.373294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ba37-0893-4d1e-a4da-6919d2f73d2a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:22.374738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 698/1415] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:22.379525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b15eb-0b90-45c8-b769-d91da53a11ef None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:22.380526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b15eb-0b90-45c8-b769-d91da53a11ef None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:22.381159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b15eb-0b90-45c8-b769-d91da53a11ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:22.454828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a83b15eb-0b90-45c8-b769-d91da53a11ef None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:22.456014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a83b15eb-0b90-45c8-b769-d91da53a11ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:22.483004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:22.553859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 718/1416] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:22.705436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2ba37-0893-4d1e-a4da-6919d2f73d2a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:22.706942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d2f2ba37-0893-4d1e-a4da-6919d2f73d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:22.851893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2ba37-0893-4d1e-a4da-6919d2f73d2a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:22.890982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:22.963557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38816-afb7-4e76-b206-0553de764390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:22.964120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38816-afb7-4e76-b206-0553de764390 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:22.964403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38816-afb7-4e76-b206-0553de764390 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:22.964680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38816-afb7-4e76-b206-0553de764390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:22.966302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-49a38816-afb7-4e76-b206-0553de764390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:23.054503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38816-afb7-4e76-b206-0553de764390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:23.056157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38816-afb7-4e76-b206-0553de764390 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:23.074051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 699/1417] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:23.959394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16fa85-d2d9-422d-abc8-af34e0e3feec None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:23.959973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16fa85-d2d9-422d-abc8-af34e0e3feec None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:23.959973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16fa85-d2d9-422d-abc8-af34e0e3feec None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:23.961356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 719/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:23.966347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950046-56a5-4086-9b8a-71c6edd22fe2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:23.966828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950046-56a5-4086-9b8a-71c6edd22fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:23.966925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f950046-56a5-4086-9b8a-71c6edd22fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:24.020796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:24.043098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8f950046-56a5-4086-9b8a-71c6edd22fe2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:24.044312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8f950046-56a5-4086-9b8a-71c6edd22fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:24.140769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 700/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:24.295683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16fa85-d2d9-422d-abc8-af34e0e3feec None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:24.297115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-de16fa85-d2d9-422d-abc8-af34e0e3feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:24.441188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16fa85-d2d9-422d-abc8-af34e0e3feec None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:24.453187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:24.556779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0353-2c48-47c1-a88b-e391d6ebee30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:24.557373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0353-2c48-47c1-a88b-e391d6ebee30 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:24.557923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0353-2c48-47c1-a88b-e391d6ebee30 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:24.558201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0353-2c48-47c1-a88b-e391d6ebee30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:24.559948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6b9a0353-2c48-47c1-a88b-e391d6ebee30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:24.650428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0353-2c48-47c1-a88b-e391d6ebee30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:24.652066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0353-2c48-47c1-a88b-e391d6ebee30 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:24.670467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 720/1420] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:25.527169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9dde-9a30-4b94-a90e-77e6385e9298 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:25.527642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9dde-9a30-4b94-a90e-77e6385e9298 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:25.527761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9dde-9a30-4b94-a90e-77e6385e9298 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:25.529121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 701/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:25.533929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e88a86-627f-410a-8bf8-52899c5f1add None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:25.534374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e88a86-627f-410a-8bf8-52899c5f1add None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:25.534495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e88a86-627f-410a-8bf8-52899c5f1add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:25.554800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:25.609794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-41e88a86-627f-410a-8bf8-52899c5f1add None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:25.611050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-41e88a86-627f-410a-8bf8-52899c5f1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:25.706381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 721/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:25.856616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b9dde-9a30-4b94-a90e-77e6385e9298 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:25.858120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ce7b9dde-9a30-4b94-a90e-77e6385e9298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:25.966016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:26.002448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b9dde-9a30-4b94-a90e-77e6385e9298 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:26.112792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158c5a0-1654-40bc-a8da-6409b96dd26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:26.113354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158c5a0-1654-40bc-a8da-6409b96dd26f service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:26.113637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158c5a0-1654-40bc-a8da-6409b96dd26f service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:26.113912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158c5a0-1654-40bc-a8da-6409b96dd26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:26.115946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6158c5a0-1654-40bc-a8da-6409b96dd26f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:26.191736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:26.205690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158c5a0-1654-40bc-a8da-6409b96dd26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:26.207325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158c5a0-1654-40bc-a8da-6409b96dd26f service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:26.226626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 702/1423] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:27.090593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ac92-3780-475f-bfa8-62490d9d4343 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:27.091216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ac92-3780-475f-bfa8-62490d9d4343 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:27.091216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7ac92-3780-475f-bfa8-62490d9d4343 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:27.092568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 722/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:23:27.097765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2e14-a21a-4339-ae0f-43b42f33d478 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:27.098222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2e14-a21a-4339-ae0f-43b42f33d478 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:27.098333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2e14-a21a-4339-ae0f-43b42f33d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:27.172963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c22c2e14-a21a-4339-ae0f-43b42f33d478 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:27.174200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c22c2e14-a21a-4339-ae0f-43b42f33d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:27.271261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 703/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:27.425389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ac92-3780-475f-bfa8-62490d9d4343 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:27.428053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0db7ac92-3780-475f-bfa8-62490d9d4343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:27.511838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:27.573005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7ac92-3780-475f-bfa8-62490d9d4343 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:27.686540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009f6d7-3de3-4e1b-b5a2-8a98d1e7a910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:27.687153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f6d7-3de3-4e1b-b5a2-8a98d1e7a910 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:27.687438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f6d7-3de3-4e1b-b5a2-8a98d1e7a910 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:27.687716 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009f6d7-3de3-4e1b-b5a2-8a98d1e7a910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:27.689662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6009f6d7-3de3-4e1b-b5a2-8a98d1e7a910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:27.738809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:27.783414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009f6d7-3de3-4e1b-b5a2-8a98d1e7a910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:27.785011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009f6d7-3de3-4e1b-b5a2-8a98d1e7a910 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:27.804034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 723/1426] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:28.700792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec62d-ec4b-49b0-ba2f-c3558ccb646b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:28.701373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec62d-ec4b-49b0-ba2f-c3558ccb646b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:28.701373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec62d-ec4b-49b0-ba2f-c3558ccb646b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:28.702788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 704/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:28.707828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897f31-88c7-4519-b9c9-9f163ea857f6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:28.708347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897f31-88c7-4519-b9c9-9f163ea857f6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:28.708509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897f31-88c7-4519-b9c9-9f163ea857f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:28.787673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-93897f31-88c7-4519-b9c9-9f163ea857f6 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:28.788841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-93897f31-88c7-4519-b9c9-9f163ea857f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:28.887261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 724/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:29.039271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec62d-ec4b-49b0-ba2f-c3558ccb646b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:29.040723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-53cec62d-ec4b-49b0-ba2f-c3558ccb646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:29.089615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:29.186882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec62d-ec4b-49b0-ba2f-c3558ccb646b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:29.299730 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10badcf7-eb32-4f68-98e4-ef4ef00f159e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:29.300300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10badcf7-eb32-4f68-98e4-ef4ef00f159e service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:29.300588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10badcf7-eb32-4f68-98e4-ef4ef00f159e service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:29.300869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10badcf7-eb32-4f68-98e4-ef4ef00f159e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:29.303380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-10badcf7-eb32-4f68-98e4-ef4ef00f159e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:29.310430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:29.394774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10badcf7-eb32-4f68-98e4-ef4ef00f159e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:29.396563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10badcf7-eb32-4f68-98e4-ef4ef00f159e service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:29.415669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 705/1429] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:30.308821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd6d9a-37b5-4e15-8136-43ff6560978c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:30.309427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd6d9a-37b5-4e15-8136-43ff6560978c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:30.309427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd6d9a-37b5-4e15-8136-43ff6560978c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:30.310803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 725/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:23:30.315828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ae39-da6f-4ccb-91b0-2ec9d24adfdf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:30.316270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ae39-da6f-4ccb-91b0-2ec9d24adfdf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:30.316485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07ae39-da6f-4ccb-91b0-2ec9d24adfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:30.390798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6c07ae39-da6f-4ccb-91b0-2ec9d24adfdf None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:30.392006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6c07ae39-da6f-4ccb-91b0-2ec9d24adfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:30.459884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:30.487833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 706/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:30.640249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd6d9a-37b5-4e15-8136-43ff6560978c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:30.641780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-edbd6d9a-37b5-4e15-8136-43ff6560978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:30.659392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:30.789196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd6d9a-37b5-4e15-8136-43ff6560978c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:30.878632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:30.903813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc8ed-77d7-4227-9c49-e93617934ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:30.904394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc8ed-77d7-4227-9c49-e93617934ce5 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:30.904681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc8ed-77d7-4227-9c49-e93617934ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:30.904952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc8ed-77d7-4227-9c49-e93617934ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:30.907267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fcccc8ed-77d7-4227-9c49-e93617934ce5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:30.995346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc8ed-77d7-4227-9c49-e93617934ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:30.996920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc8ed-77d7-4227-9c49-e93617934ce5 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:31.014951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 726/1432] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:31.913339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc104fbe-b118-4f5c-96fc-dbec01c38363 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:31.913914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc104fbe-b118-4f5c-96fc-dbec01c38363 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:31.913914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc104fbe-b118-4f5c-96fc-dbec01c38363 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:31.915323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 707/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:31.920476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ebfb9-03ab-43ec-8162-482943ac1dff None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:31.920934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ebfb9-03ab-43ec-8162-482943ac1dff None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:31.921030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ebfb9-03ab-43ec-8162-482943ac1dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:31.998572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e23ebfb9-03ab-43ec-8162-482943ac1dff None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:31.999868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e23ebfb9-03ab-43ec-8162-482943ac1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:32.043679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:32.100138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 727/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:32.252316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc104fbe-b118-4f5c-96fc-dbec01c38363 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:32.253749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fc104fbe-b118-4f5c-96fc-dbec01c38363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:32.399841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc104fbe-b118-4f5c-96fc-dbec01c38363 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:32.454136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:32.513371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f44426-e078-463b-b5ff-4753fb1488f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:32.514023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44426-e078-463b-b5ff-4753fb1488f2 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:32.514306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44426-e078-463b-b5ff-4753fb1488f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:32.514582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f44426-e078-463b-b5ff-4753fb1488f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:32.516238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-86f44426-e078-463b-b5ff-4753fb1488f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:32.607443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f44426-e078-463b-b5ff-4753fb1488f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:32.609059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f44426-e078-463b-b5ff-4753fb1488f2 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:32.627069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 708/1435] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:33.490507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fc481-78ea-4454-b9bd-5113f02519bc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:33.491099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fc481-78ea-4454-b9bd-5113f02519bc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:33.491099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fc481-78ea-4454-b9bd-5113f02519bc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:33.492533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 728/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:33.497853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea5dc2-4743-4524-b39b-96f3451cd4f0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:33.498318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea5dc2-4743-4524-b39b-96f3451cd4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:33.498435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea5dc2-4743-4524-b39b-96f3451cd4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:33.575380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-49ea5dc2-4743-4524-b39b-96f3451cd4f0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:33.576604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-49ea5dc2-4743-4524-b39b-96f3451cd4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:33.578684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:33.678785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 709/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:33.828446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fc481-78ea-4454-b9bd-5113f02519bc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:33.829919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-853fc481-78ea-4454-b9bd-5113f02519bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:33.979592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fc481-78ea-4454-b9bd-5113f02519bc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:34.007235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:34.093352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd6d8e-b181-4f57-8cd3-98a571882982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:34.094012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd6d8e-b181-4f57-8cd3-98a571882982 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:34.094295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd6d8e-b181-4f57-8cd3-98a571882982 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:34.094572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd6d8e-b181-4f57-8cd3-98a571882982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:34.096232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ecd6d8e-b181-4f57-8cd3-98a571882982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:34.184332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd6d8e-b181-4f57-8cd3-98a571882982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:34.185912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd6d8e-b181-4f57-8cd3-98a571882982 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:34.203621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 729/1438] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:36.143730 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb225f9-aecb-4c75-af4a-2fc1ac466d27 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:36.144341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb225f9-aecb-4c75-af4a-2fc1ac466d27 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:36.144341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb225f9-aecb-4c75-af4a-2fc1ac466d27 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:36.146242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 710/1439] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:36.151911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dad32-0721-421d-87a8-4988e169b434 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:36.152343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dad32-0721-421d-87a8-4988e169b434 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:36.152455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dad32-0721-421d-87a8-4988e169b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:36.194125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:36.218950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-365dad32-0721-421d-87a8-4988e169b434 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:36.222096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-365dad32-0721-421d-87a8-4988e169b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:36.317088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 730/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:36.356057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb225f9-aecb-4c75-af4a-2fc1ac466d27 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:36.357574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-efb225f9-aecb-4c75-af4a-2fc1ac466d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:36.460382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb225f9-aecb-4c75-af4a-2fc1ac466d27 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:36.492408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:36.535382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490e432-f145-4a59-ac0b-a0e36b51e1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:36.536076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e432-f145-4a59-ac0b-a0e36b51e1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:36.536502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e432-f145-4a59-ac0b-a0e36b51e1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:36.536623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e432-f145-4a59-ac0b-a0e36b51e1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:36.538258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b490e432-f145-4a59-ac0b-a0e36b51e1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:36.646808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490e432-f145-4a59-ac0b-a0e36b51e1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:36.648577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490e432-f145-4a59-ac0b-a0e36b51e1f6 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:36.667050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 711/1441] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:38.869914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8360-d785-413e-859b-5a52f9b2b557 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:38.870476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8360-d785-413e-859b-5a52f9b2b557 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:38.870593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8360-d785-413e-859b-5a52f9b2b557 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:38.871930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 731/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:38.877093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222894-55a9-4664-bed2-d5fc144436e3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:38.877499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222894-55a9-4664-bed2-d5fc144436e3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:38.877655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec222894-55a9-4664-bed2-d5fc144436e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:38.942751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ec222894-55a9-4664-bed2-d5fc144436e3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:38.943967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ec222894-55a9-4664-bed2-d5fc144436e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:38.956817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:39.042389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 712/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:39.080765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8360-d785-413e-859b-5a52f9b2b557 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:39.082286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a6a8360-d785-413e-859b-5a52f9b2b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:39.184914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8360-d785-413e-859b-5a52f9b2b557 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:39.197643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:39.259891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5626247-c7ac-4106-99df-4996b46c3f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:39.260542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5626247-c7ac-4106-99df-4996b46c3f3b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:39.260835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5626247-c7ac-4106-99df-4996b46c3f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:39.261112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5626247-c7ac-4106-99df-4996b46c3f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:39.262797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5626247-c7ac-4106-99df-4996b46c3f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:39.373089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5626247-c7ac-4106-99df-4996b46c3f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:39.374530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5626247-c7ac-4106-99df-4996b46c3f3b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:39.393449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 732/1444] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:41.820105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4becc-23ca-40c8-8189-ccb28fdf439b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:41.820669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4becc-23ca-40c8-8189-ccb28fdf439b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:41.820669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4becc-23ca-40c8-8189-ccb28fdf439b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:41.822059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 713/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:41.827215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c44bc-568d-42c5-92d3-dc46519ed7b6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:41.827626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c44bc-568d-42c5-92d3-dc46519ed7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:41.827769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c44bc-568d-42c5-92d3-dc46519ed7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:41.874951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:41.892438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-eb5c44bc-568d-42c5-92d3-dc46519ed7b6 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:41.893673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eb5c44bc-568d-42c5-92d3-dc46519ed7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:41.990188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 733/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:42.030275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4becc-23ca-40c8-8189-ccb28fdf439b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:42.031887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-14b4becc-23ca-40c8-8189-ccb28fdf439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:42.133774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4becc-23ca-40c8-8189-ccb28fdf439b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:42.173562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:42.207388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b3f1-3662-4e9c-b712-ab22751fb5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:42.208091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b3f1-3662-4e9c-b712-ab22751fb5fe service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:42.208447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b3f1-3662-4e9c-b712-ab22751fb5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:42.208725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b3f1-3662-4e9c-b712-ab22751fb5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:42.210359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bc65b3f1-3662-4e9c-b712-ab22751fb5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:42.317405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65b3f1-3662-4e9c-b712-ab22751fb5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:42.318870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65b3f1-3662-4e9c-b712-ab22751fb5fe service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:42.337505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 714/1447] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:44.507259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0d72-6dde-4760-8c1a-51ef40544182 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:44.507836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0d72-6dde-4760-8c1a-51ef40544182 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:44.507836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0d72-6dde-4760-8c1a-51ef40544182 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:44.509231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 734/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:44.514745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0735b-fe55-44fc-898d-04dead09e833 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:44.515156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0735b-fe55-44fc-898d-04dead09e833 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:44.515302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0735b-fe55-44fc-898d-04dead09e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:44.580402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c5a0735b-fe55-44fc-898d-04dead09e833 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:44.581612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c5a0735b-fe55-44fc-898d-04dead09e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:44.603431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:44.680786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 715/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:44.720393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f0d72-6dde-4760-8c1a-51ef40544182 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:44.721934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aa9f0d72-6dde-4760-8c1a-51ef40544182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:44.826566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f0d72-6dde-4760-8c1a-51ef40544182 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:44.846157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:44.900641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022dc72-1de1-45b6-ad2a-d0f51d19e33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:44.901289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022dc72-1de1-45b6-ad2a-d0f51d19e33d service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:44.901575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022dc72-1de1-45b6-ad2a-d0f51d19e33d service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:44.901850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022dc72-1de1-45b6-ad2a-d0f51d19e33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:44.903575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0022dc72-1de1-45b6-ad2a-d0f51d19e33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:45.016523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022dc72-1de1-45b6-ad2a-d0f51d19e33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:45.017953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022dc72-1de1-45b6-ad2a-d0f51d19e33d service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:45.036864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 735/1450] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:47.147505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b210f3-71cb-4c53-a7ee-667ff2041a51 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:47.148326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b210f3-71cb-4c53-a7ee-667ff2041a51 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:47.148445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b210f3-71cb-4c53-a7ee-667ff2041a51 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:47.149831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 716/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:47.155321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670b40b-95aa-4af2-8332-c4e54885437c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:47.155774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670b40b-95aa-4af2-8332-c4e54885437c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:47.155917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670b40b-95aa-4af2-8332-c4e54885437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:47.218584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:47.221354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a670b40b-95aa-4af2-8332-c4e54885437c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:47.222557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a670b40b-95aa-4af2-8332-c4e54885437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:47.318436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 736/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:23:47.358154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b210f3-71cb-4c53-a7ee-667ff2041a51 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:47.359749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c7b210f3-71cb-4c53-a7ee-667ff2041a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:47.583826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b210f3-71cb-4c53-a7ee-667ff2041a51 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:47.633442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:47.657543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37aa04-0200-4c18-b480-f98a4241241b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:47.658193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37aa04-0200-4c18-b480-f98a4241241b service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:47.658479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37aa04-0200-4c18-b480-f98a4241241b service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:47.658848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37aa04-0200-4c18-b480-f98a4241241b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:47.661260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ce37aa04-0200-4c18-b480-f98a4241241b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:47.770789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37aa04-0200-4c18-b480-f98a4241241b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:47.772154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37aa04-0200-4c18-b480-f98a4241241b service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:47.789994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 717/1453] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:50.018924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57abe1d-6556-4927-ac39-54bfaa70976b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:50.019473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57abe1d-6556-4927-ac39-54bfaa70976b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:50.019473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57abe1d-6556-4927-ac39-54bfaa70976b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:50.021835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 737/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:50.027377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532a98-d3a8-4522-8755-f44bd8b4b262 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:50.027824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532a98-d3a8-4522-8755-f44bd8b4b262 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:50.027947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532a98-d3a8-4522-8755-f44bd8b4b262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:50.091987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f7532a98-d3a8-4522-8755-f44bd8b4b262 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:50.093169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f7532a98-d3a8-4522-8755-f44bd8b4b262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:50.122291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:50.189774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 718/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:50.229583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57abe1d-6556-4927-ac39-54bfaa70976b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:50.231195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c57abe1d-6556-4927-ac39-54bfaa70976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:50.344719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57abe1d-6556-4927-ac39-54bfaa70976b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:50.372969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:50.419500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122cafc-2a63-4edb-8651-bf16d4500e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:50.420195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cafc-2a63-4edb-8651-bf16d4500e07 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:50.420477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cafc-2a63-4edb-8651-bf16d4500e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:50.420751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cafc-2a63-4edb-8651-bf16d4500e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:50.422367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f122cafc-2a63-4edb-8651-bf16d4500e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:50.530938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122cafc-2a63-4edb-8651-bf16d4500e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:50.532382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122cafc-2a63-4edb-8651-bf16d4500e07 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:50.552236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 738/1456] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:52.706260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d434-99b1-4eb4-a64e-daf4d7b4b6c2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:52.706855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d434-99b1-4eb4-a64e-daf4d7b4b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:52.706855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d434-99b1-4eb4-a64e-daf4d7b4b6c2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:52.708567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 719/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:52.713908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aea0c-5a78-4ca4-bec7-1c0ec9f87795 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:52.714352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aea0c-5a78-4ca4-bec7-1c0ec9f87795 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:52.714469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aea0c-5a78-4ca4-bec7-1c0ec9f87795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:52.777763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-af1aea0c-5a78-4ca4-bec7-1c0ec9f87795 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:52.778920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af1aea0c-5a78-4ca4-bec7-1c0ec9f87795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:52.787557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:52.874937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 739/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:52.914312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d434-99b1-4eb4-a64e-daf4d7b4b6c2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:52.915871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1d40d434-99b1-4eb4-a64e-daf4d7b4b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:53.018533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d434-99b1-4eb4-a64e-daf4d7b4b6c2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:53.073373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:53.091713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73101fa7-0717-4182-a5d4-176f4dda0f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:53.092345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101fa7-0717-4182-a5d4-176f4dda0f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:53.092626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101fa7-0717-4182-a5d4-176f4dda0f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:53.092899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73101fa7-0717-4182-a5d4-176f4dda0f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:53.094547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-73101fa7-0717-4182-a5d4-176f4dda0f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:53.200441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73101fa7-0717-4182-a5d4-176f4dda0f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:53.201886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73101fa7-0717-4182-a5d4-176f4dda0f92 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:53.220649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 720/1459] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:55.293291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254958-b0e6-4e15-93ee-816530c20a39 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:55.293888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254958-b0e6-4e15-93ee-816530c20a39 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:55.293888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254958-b0e6-4e15-93ee-816530c20a39 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:55.295244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 740/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:55.300369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9d7f-c2b4-45e3-ac6c-02e2dd6e0cd6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:55.300808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9d7f-c2b4-45e3-ac6c-02e2dd6e0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:55.300934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9d7f-c2b4-45e3-ac6c-02e2dd6e0cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:55.369640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cd7b9d7f-c2b4-45e3-ac6c-02e2dd6e0cd6 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:55.369640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cd7b9d7f-c2b4-45e3-ac6c-02e2dd6e0cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:55.410487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:55.468232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 721/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:55.507139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254958-b0e6-4e15-93ee-816530c20a39 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:55.508678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a2254958-b0e6-4e15-93ee-816530c20a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:55.612667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254958-b0e6-4e15-93ee-816530c20a39 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:55.650814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:55.687807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8df15-304a-4966-98e4-c80935311add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:55.688458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8df15-304a-4966-98e4-c80935311add service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:55.688741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8df15-304a-4966-98e4-c80935311add service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:55.689018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8df15-304a-4966-98e4-c80935311add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:55.690663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3c8df15-304a-4966-98e4-c80935311add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:55.798530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8df15-304a-4966-98e4-c80935311add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:55.799997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8df15-304a-4966-98e4-c80935311add service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:55.819119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 741/1462] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:23:57.892359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b65c1e-a9d3-48d4-b84f-953f672bf9b0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:57.892960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b65c1e-a9d3-48d4-b84f-953f672bf9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:57.892960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b65c1e-a9d3-48d4-b84f-953f672bf9b0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:57.894325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 722/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:23:57.900784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9081-c723-400a-89c9-48a1edbb8ae3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:57.901226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9081-c723-400a-89c9-48a1edbb8ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:57.901327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9081-c723-400a-89c9-48a1edbb8ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:57.973791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-853a9081-c723-400a-89c9-48a1edbb8ae3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:23:57.975032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-853a9081-c723-400a-89c9-48a1edbb8ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:58.003825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:58.081380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 742/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:23:58.118435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b65c1e-a9d3-48d4-b84f-953f672bf9b0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:23:58.120009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e0b65c1e-a9d3-48d4-b84f-953f672bf9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:58.222074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b65c1e-a9d3-48d4-b84f-953f672bf9b0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:23:58.292633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:58.299286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf06abe-690b-478f-8c72-7a6c556e86e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:23:58.299923 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06abe-690b-478f-8c72-7a6c556e86e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:23:58.300203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06abe-690b-478f-8c72-7a6c556e86e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:23:58.300472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf06abe-690b-478f-8c72-7a6c556e86e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:23:58.305802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7bf06abe-690b-478f-8c72-7a6c556e86e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:23:58.408791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf06abe-690b-478f-8c72-7a6c556e86e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:23:58.410212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf06abe-690b-478f-8c72-7a6c556e86e3 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:23:58.428324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 723/1465] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:00.480819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61d12-ed0d-4735-8335-649a25addcd7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:00.481493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61d12-ed0d-4735-8335-649a25addcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:00.481493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a61d12-ed0d-4735-8335-649a25addcd7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:00.482818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 743/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:00.488224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7c6f-4838-40a7-8641-80a324356ffe None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:00.488642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7c6f-4838-40a7-8641-80a324356ffe None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:00.488829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7c6f-4838-40a7-8641-80a324356ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:00.553353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-256d7c6f-4838-40a7-8641-80a324356ffe None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:00.554565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-256d7c6f-4838-40a7-8641-80a324356ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:00.602504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:00.649961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 724/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:00.687203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61d12-ed0d-4735-8335-649a25addcd7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:00.688760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e6a61d12-ed0d-4735-8335-649a25addcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:00.792878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a61d12-ed0d-4735-8335-649a25addcd7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:00.840420 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:00.866462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0590deb-c087-4b4a-bcf3-eea19c5ff770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:00.867355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590deb-c087-4b4a-bcf3-eea19c5ff770 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:00.867830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590deb-c087-4b4a-bcf3-eea19c5ff770 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:00.868408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590deb-c087-4b4a-bcf3-eea19c5ff770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:00.870063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f0590deb-c087-4b4a-bcf3-eea19c5ff770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:00.977109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0590deb-c087-4b4a-bcf3-eea19c5ff770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:00.978540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0590deb-c087-4b4a-bcf3-eea19c5ff770 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:00.996827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 744/1468] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:10.647852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=22 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:10.994532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=66 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:20.945238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf0239-6077-462d-8524-5949ac502eb6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:20.945819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf0239-6077-462d-8524-5949ac502eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:20.945819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf0239-6077-462d-8524-5949ac502eb6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:20.947233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 725/1469] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:20.952532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74393-5cae-426e-b4e6-5e7ec6e07c6a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:20.952971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74393-5cae-426e-b4e6-5e7ec6e07c6a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:20.953105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74393-5cae-426e-b4e6-5e7ec6e07c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:21.017282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-93d74393-5cae-426e-b4e6-5e7ec6e07c6a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:21.018466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-93d74393-5cae-426e-b4e6-5e7ec6e07c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:21.116152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 745/1470] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:21.200195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd9f8-b58a-420d-ab50-791cb3f7bdc6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:21.200456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd9f8-b58a-420d-ab50-791cb3f7bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:21.200737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd9f8-b58a-420d-ab50-791cb3f7bdc6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:21.202098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 726/1471] 10.222.0.87 () {54 vars in 966 bytes} [Wed Jul 20 15:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:21.207145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9916640-7737-4c14-b959-a150025d814c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:21.207543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9916640-7737-4c14-b959-a150025d814c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:21.207828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9916640-7737-4c14-b959-a150025d814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:21.281778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e9916640-7737-4c14-b959-a150025d814c None None] MFA Rules not processed for user `5d166e2866794925bd5bde02040239dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:21.283027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e9916640-7737-4c14-b959-a150025d814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:21.304105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:21.359229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 746/1472] 10.222.0.87 () {58 vars in 1063 bytes} [Wed Jul 20 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:21.366879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd9f8-b58a-420d-ab50-791cb3f7bdc6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:21.368403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-10fdd9f8-b58a-420d-ab50-791cb3f7bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:21.477836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd9f8-b58a-420d-ab50-791cb3f7bdc6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:21.554524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca72d0-c2bf-49b2-a0dc-612c67512e92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:21.558559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca72d0-c2bf-49b2-a0dc-612c67512e92 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:21.558559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca72d0-c2bf-49b2-a0dc-612c67512e92 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:21.558559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca72d0-c2bf-49b2-a0dc-612c67512e92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:21.558559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b5ca72d0-c2bf-49b2-a0dc-612c67512e92 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:21.611645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:21.665768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca72d0-c2bf-49b2-a0dc-612c67512e92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:21.667249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca72d0-c2bf-49b2-a0dc-612c67512e92 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:21.685161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 727/1473] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:23.818543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d8e86-64da-4462-b882-c8202fa68a68 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:23.819122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d8e86-64da-4462-b882-c8202fa68a68 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:23.819122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d8e86-64da-4462-b882-c8202fa68a68 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:23.820469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 747/1474] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:23.825672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218667a8-a785-4516-9f56-1b87d1e82c21 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:23.826125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218667a8-a785-4516-9f56-1b87d1e82c21 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:23.826228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218667a8-a785-4516-9f56-1b87d1e82c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:23.890142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-218667a8-a785-4516-9f56-1b87d1e82c21 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:23.891371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-218667a8-a785-4516-9f56-1b87d1e82c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:23.987265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 728/1475] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:24.010899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d8e86-64da-4462-b882-c8202fa68a68 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:24.012418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ba3d8e86-64da-4462-b882-c8202fa68a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:24.136872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d8e86-64da-4462-b882-c8202fa68a68 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:24.185178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:24.229730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41ea54-fc9e-4a31-8364-16894f71c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:24.230393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41ea54-fc9e-4a31-8364-16894f71c89a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:24.230704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41ea54-fc9e-4a31-8364-16894f71c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:24.230983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41ea54-fc9e-4a31-8364-16894f71c89a admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:24.231745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41ea54-fc9e-4a31-8364-16894f71c89a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:24.233460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-cc41ea54-fc9e-4a31-8364-16894f71c89a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:24:24.233460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:24:24.233460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:24:24.234595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41ea54-fc9e-4a31-8364-16894f71c89a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:24.254535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 748/1476] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Jul 20 15:24:24 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:24:26.314919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a934-f8ad-4d85-ad05-64f68ebb5b9e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:26.315469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a934-f8ad-4d85-ad05-64f68ebb5b9e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:26.315568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248a934-f8ad-4d85-ad05-64f68ebb5b9e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:26.317441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 729/1477] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:26.322720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c268a-de66-4dfb-ac64-0beff0d27e81 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:26.323156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c268a-de66-4dfb-ac64-0beff0d27e81 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:26.323269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c268a-de66-4dfb-ac64-0beff0d27e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:26.387332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-012c268a-de66-4dfb-ac64-0beff0d27e81 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:26.388520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-012c268a-de66-4dfb-ac64-0beff0d27e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:26.485496 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 749/1478] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:26.530701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248a934-f8ad-4d85-ad05-64f68ebb5b9e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:26.532212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e248a934-f8ad-4d85-ad05-64f68ebb5b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:26.541952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:26.678396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248a934-f8ad-4d85-ad05-64f68ebb5b9e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:26.756612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:26.789751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcdb8e-f92e-4c08-9ad7-bc2199974fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:26.790394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcdb8e-f92e-4c08-9ad7-bc2199974fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:26.790703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcdb8e-f92e-4c08-9ad7-bc2199974fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:26.790987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcdb8e-f92e-4c08-9ad7-bc2199974fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:26.792618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9bbcdb8e-f92e-4c08-9ad7-bc2199974fc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:26.881582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcdb8e-f92e-4c08-9ad7-bc2199974fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:26.883235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcdb8e-f92e-4c08-9ad7-bc2199974fc4 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:26.901172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 730/1479] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:29.208337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe13ad1-bc48-49ad-a580-af9e88037d43 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:29.208928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe13ad1-bc48-49ad-a580-af9e88037d43 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:29.208928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe13ad1-bc48-49ad-a580-af9e88037d43 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:29.210300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 750/1480] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:29.215936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67938-0a9d-48b2-85c6-878fc3ae44eb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:29.216388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67938-0a9d-48b2-85c6-878fc3ae44eb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:29.216508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67938-0a9d-48b2-85c6-878fc3ae44eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:29.283028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7ac67938-0a9d-48b2-85c6-878fc3ae44eb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:29.284242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7ac67938-0a9d-48b2-85c6-878fc3ae44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:29.330377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:29.381264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 731/1481] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:29.418345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe13ad1-bc48-49ad-a580-af9e88037d43 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:29.419903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fbe13ad1-bc48-49ad-a580-af9e88037d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:29.444029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:29.533181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe13ad1-bc48-49ad-a580-af9e88037d43 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:29.605688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e3f87-8d8a-4b6a-8663-bf4e94ed8866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:29.606338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e3f87-8d8a-4b6a-8663-bf4e94ed8866 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:29.606622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e3f87-8d8a-4b6a-8663-bf4e94ed8866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:29.606932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e3f87-8d8a-4b6a-8663-bf4e94ed8866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:29.608556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a22e3f87-8d8a-4b6a-8663-bf4e94ed8866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:29.681296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:29.715808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e3f87-8d8a-4b6a-8663-bf4e94ed8866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:29.717256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e3f87-8d8a-4b6a-8663-bf4e94ed8866 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:29.734892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 751/1482] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:31.881060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64645-a1fd-4b26-b818-b0c853a593dd None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:31.881646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64645-a1fd-4b26-b818-b0c853a593dd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:31.881646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64645-a1fd-4b26-b818-b0c853a593dd None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:31.883025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 732/1483] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:31.888364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bae909-f005-402e-9461-64870c38d384 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:31.888841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bae909-f005-402e-9461-64870c38d384 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:31.888946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bae909-f005-402e-9461-64870c38d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:31.953655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-54bae909-f005-402e-9461-64870c38d384 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:31.954887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-54bae909-f005-402e-9461-64870c38d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:32.052673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 752/1484] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:32.092227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64645-a1fd-4b26-b818-b0c853a593dd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:32.093810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-85f64645-a1fd-4b26-b818-b0c853a593dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:32.203503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64645-a1fd-4b26-b818-b0c853a593dd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:32.278822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:32.280599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10a299-e6b1-40ba-93a7-bbcec9dca251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:32.281246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a299-e6b1-40ba-93a7-bbcec9dca251 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:32.281532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a299-e6b1-40ba-93a7-bbcec9dca251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:32.281810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10a299-e6b1-40ba-93a7-bbcec9dca251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:32.283489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cd10a299-e6b1-40ba-93a7-bbcec9dca251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:32.400493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10a299-e6b1-40ba-93a7-bbcec9dca251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:32.401950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10a299-e6b1-40ba-93a7-bbcec9dca251 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:32.421431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 733/1485] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:34.570842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd55afb-a04a-4964-9594-c7b88c343e90 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:34.571370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd55afb-a04a-4964-9594-c7b88c343e90 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:34.571370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd55afb-a04a-4964-9594-c7b88c343e90 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:34.572834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 753/1486] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:34.578212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918778-e990-4fd1-91e2-f2b6ca19a143 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:34.583361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918778-e990-4fd1-91e2-f2b6ca19a143 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:34.583361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918778-e990-4fd1-91e2-f2b6ca19a143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:34.643262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cc918778-e990-4fd1-91e2-f2b6ca19a143 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:34.644738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cc918778-e990-4fd1-91e2-f2b6ca19a143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:34.697516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:34.741456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 734/1487] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:34.798404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180370-7b80-40b6-8ce6-44af8215a08c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:34.798718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180370-7b80-40b6-8ce6-44af8215a08c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:34.799000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a180370-7b80-40b6-8ce6-44af8215a08c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:34.801056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 754/1488] 10.222.0.87 () {54 vars in 965 bytes} [Wed Jul 20 15:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:34.807404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd2fa3-c8ca-4750-a2b4-9cc39f8045d3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:34.807693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd2fa3-c8ca-4750-a2b4-9cc39f8045d3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:34.807971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd2fa3-c8ca-4750-a2b4-9cc39f8045d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:34.880821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3bdd2fa3-c8ca-4750-a2b4-9cc39f8045d3 None None] MFA Rules not processed for user `a1c06e34aaac441e8b1a6366cc384524`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:34.882020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3bdd2fa3-c8ca-4750-a2b4-9cc39f8045d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:34.957824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 735/1489] 10.222.0.87 () {58 vars in 1062 bytes} [Wed Jul 20 15:24:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:34.966683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a180370-7b80-40b6-8ce6-44af8215a08c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:34.968235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7a180370-7b80-40b6-8ce6-44af8215a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:35.004112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:35.071690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a180370-7b80-40b6-8ce6-44af8215a08c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:35.144788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e475257-b759-47d1-99d2-d459ba16b941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:35.145438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475257-b759-47d1-99d2-d459ba16b941 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:35.145717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475257-b759-47d1-99d2-d459ba16b941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:35.145990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475257-b759-47d1-99d2-d459ba16b941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:35.147653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9e475257-b759-47d1-99d2-d459ba16b941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:35.227212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:35.256649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e475257-b759-47d1-99d2-d459ba16b941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:35.258098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e475257-b759-47d1-99d2-d459ba16b941 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:35.277458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 755/1490] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:38.201932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501b0c-12d7-4718-8f24-0fd64b057bb7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:38.202500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501b0c-12d7-4718-8f24-0fd64b057bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:38.202500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501b0c-12d7-4718-8f24-0fd64b057bb7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:38.203926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 736/1491] 10.222.0.87 () {54 vars in 926 bytes} [Wed Jul 20 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:24:38.209520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b47ad-44e9-4b3a-b876-858c350004b5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:38.209932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b47ad-44e9-4b3a-b876-858c350004b5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:38.210094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b47ad-44e9-4b3a-b876-858c350004b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:38.275576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-313b47ad-44e9-4b3a-b876-858c350004b5 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:24:38.276760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-313b47ad-44e9-4b3a-b876-858c350004b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:38.372362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 756/1492] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Jul 20 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:24:38.412823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501b0c-12d7-4718-8f24-0fd64b057bb7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:24:38.414315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a8501b0c-12d7-4718-8f24-0fd64b057bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:38.466493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:38.517903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501b0c-12d7-4718-8f24-0fd64b057bb7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:24:38.591375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfcfda-5928-4dd2-8f9e-0bbddbce224e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:24:38.592022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfcfda-5928-4dd2-8f9e-0bbddbce224e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:24:38.592308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfcfda-5928-4dd2-8f9e-0bbddbce224e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:24:38.592587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfcfda-5928-4dd2-8f9e-0bbddbce224e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:24:38.594210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5bbfcfda-5928-4dd2-8f9e-0bbddbce224e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:24:38.690396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:38.703147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfcfda-5928-4dd2-8f9e-0bbddbce224e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:24:38.704607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfcfda-5928-4dd2-8f9e-0bbddbce224e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:24:38.724099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 737/1493] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:48.370553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=82 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:48.720873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=9 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:16.007492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:16.008125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:16.008125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:16.083678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:16.084862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:16.179614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 757/1494] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:16.187734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33654f-66d8-4f29-9b5d-2cab1ad29402 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:16.188359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33654f-66d8-4f29-9b5d-2cab1ad29402 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:16.188359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33654f-66d8-4f29-9b5d-2cab1ad29402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:16.263491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4f33654f-66d8-4f29-9b5d-2cab1ad29402 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:16.264600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4f33654f-66d8-4f29-9b5d-2cab1ad29402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:16.360726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 738/1495] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:16.366787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:16.368127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:16.380620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df12592-6fca-4105-9f5a-cc48837ece2c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:16.442962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:16.476540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:16.477558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:16.478051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:16.478664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:16.479512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:26:16.479920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:16.481041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:16.481041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:26:16.481041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:26:16.482206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:16.504199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 758/1496] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:26:16.508204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33654f-66d8-4f29-9b5d-2cab1ad29402 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:16.590634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33654f-66d8-4f29-9b5d-2cab1ad29402 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:16.590634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:16.620932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:16.621591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:16.621880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:16.622146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:16.622864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:16.624660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:16.624660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 20 15:26:16.624660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: Jul 20 15:26:16.626052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:16.747914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 739/1497] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:26:16 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:26:16.752247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:16.753790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:16.787431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6948b-5ff6-4986-8d07-e54ffa56ea06 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:16.883077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:16.883650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:16.883931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:16.884204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:16.884895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:16.885898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:16.885898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:26:16.885898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:26:16.887125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:17.049863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 759/1498] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:26:16 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:26:17.055449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:17.056998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:17.119762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a3c28-5c6d-4331-a21a-14061b1dc9f5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:17.204543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:17.215166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:17.215837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:17.216123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:17.216404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:17.217132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:17.218209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:17.218209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 20 15:26:17.218209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: Jul 20 15:26:17.219138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:17.232265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 740/1499] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:26:17.236419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:17.238783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:17.250207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb3ea5-d4db-4d36-a470-2743dd54a3a6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:17.276445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:17.346758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a19d4-4ecf-4964-a3c2-fe4d153e7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:17.348041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a19d4-4ecf-4964-a3c2-fe4d153e7e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:17.348335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a19d4-4ecf-4964-a3c2-fe4d153e7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:17.348621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a19d4-4ecf-4964-a3c2-fe4d153e7e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:17.349349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a19d4-4ecf-4964-a3c2-fe4d153e7e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:17.350393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-4d0a19d4-4ecf-4964-a3c2-fe4d153e7e6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:17.350393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:26:17.350393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:26:17.351347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a19d4-4ecf-4964-a3c2-fe4d153e7e6a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:17.364351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 760/1500] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:26:17.368559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:17.370089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:17.403028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3270d-51b3-48da-8dd9-9db15c28c8d1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:17.497318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93adf-7e1a-49f2-8ab2-29c69add539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:17.498192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93adf-7e1a-49f2-8ab2-29c69add539e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:17.498503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93adf-7e1a-49f2-8ab2-29c69add539e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:17.498820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93adf-7e1a-49f2-8ab2-29c69add539e admin admin] PATH_INFO: `/v3/projects/c18e26eb07ee4b088e003d47ce755c90/users/bef8732aeb8549f39a413252dddfc2df/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:17.521433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc93adf-7e1a-49f2-8ab2-29c69add539e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18e26eb07ee4b088e003d47ce755c90, user_id=bef8732aeb8549f39a413252dddfc2df, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:17.522473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-1dc93adf-7e1a-49f2-8ab2-29c69add539e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:17.522473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 20 15:26:17.522473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: Jul 20 15:26:17.524469 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc93adf-7e1a-49f2-8ab2-29c69add539e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:17.603641 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 741/1501] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:26:17 2022] PUT /identity/v3/projects/c18e26eb07ee4b088e003d47ce755c90/users/bef8732aeb8549f39a413252dddfc2df/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:26:17.616282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdbe29-318f-4bdc-a8e6-5eefc8d8c486 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:17.616574 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdbe29-318f-4bdc-a8e6-5eefc8d8c486 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:17.616853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdbe29-318f-4bdc-a8e6-5eefc8d8c486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:17.672702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-27cdbe29-318f-4bdc-a8e6-5eefc8d8c486 None None] MFA Rules not processed for user `bef8732aeb8549f39a413252dddfc2df`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:17.673965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27cdbe29-318f-4bdc-a8e6-5eefc8d8c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:17.751462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 761/1502] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:17.764910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d9a6-ab7f-4410-9967-32a81f9fc179 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:17.765225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d9a6-ab7f-4410-9967-32a81f9fc179 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:17.765517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d9a6-ab7f-4410-9967-32a81f9fc179 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:17.766967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 742/1503] 10.222.0.87 () {54 vars in 964 bytes} [Wed Jul 20 15:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:17.772502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a26c0-072a-4171-a9e7-2e2bd5c6e165 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:17.772794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a26c0-072a-4171-a9e7-2e2bd5c6e165 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:17.773075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a26c0-072a-4171-a9e7-2e2bd5c6e165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:17.804005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:17.847846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1e8a26c0-072a-4171-a9e7-2e2bd5c6e165 None None] MFA Rules not processed for user `1e49a95b86044f5aa9ff4a084ee8cee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:17.849042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e8a26c0-072a-4171-a9e7-2e2bd5c6e165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:17.925693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 762/1504] 10.222.0.87 () {58 vars in 1061 bytes} [Wed Jul 20 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:17.933456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53d9a6-ab7f-4410-9967-32a81f9fc179 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:17.934988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8f53d9a6-ab7f-4410-9967-32a81f9fc179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:17.984899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:18.038018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53d9a6-ab7f-4410-9967-32a81f9fc179 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:18.109725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:18.110369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:18.110672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:18.110957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:18.112627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:18.215049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:18.216492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:18.220073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:18.234357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 743/1505] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:18.278236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e71e0-9ef2-4ad9-bee2-7ea763af9ec7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:18.278702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e71e0-9ef2-4ad9-bee2-7ea763af9ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:18.278865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e71e0-9ef2-4ad9-bee2-7ea763af9ec7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:18.280159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 763/1506] 10.222.0.87 () {52 vars in 829 bytes} [Wed Jul 20 15:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:26:18.283713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:18.285008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:18.385427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13f20c-2287-4ad8-9f9b-1645944a811a service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:18.478566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:18.479464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:18.479748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:18.480024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] PATH_INFO: `/v3/users/bef8732aeb8549f39a413252dddfc2df` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:18.493031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef8732aeb8549f39a413252dddfc2df)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:18.494069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:18.494069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 20 15:26:18.494069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: Jul 20 15:26:18.495325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:18.506011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:18.739726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef8732aeb8549f39a413252dddfc2df'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:18.757973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef8732aeb8549f39a413252dddfc2df'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:18.769634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef8732aeb8549f39a413252dddfc2df'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:19.008528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef8732aeb8549f39a413252dddfc2df'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:19.008994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef8732aeb8549f39a413252dddfc2df'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:19.028419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 744/1507] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:26:18 2022] DELETE /identity/v3/users/bef8732aeb8549f39a413252dddfc2df => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:26:19.032839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:19.033155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:19.033437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:19.088615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:26:19.089800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:19.164440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:19.177357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 764/1508] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:26:19.187573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:19.188789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:19.293019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29aa5c-58c2-4422-93bf-f48e47aefcd6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:19.347112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:19.366370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3f4e-1638-46b7-ac2d-39ef9d574a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:19.367110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3f4e-1638-46b7-ac2d-39ef9d574a09 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:19.367392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3f4e-1638-46b7-ac2d-39ef9d574a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:19.367666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3f4e-1638-46b7-ac2d-39ef9d574a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:19.369284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82bf3f4e-1638-46b7-ac2d-39ef9d574a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:19.479423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3f4e-1638-46b7-ac2d-39ef9d574a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:19.480883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3f4e-1638-46b7-ac2d-39ef9d574a09 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:19.499502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 745/1509] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:26:20.102555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:26:20.103894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:26:20.116850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ba75c-6d5b-4567-a6f2-a596353759f1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:26:20.214431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:26:20.215333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:26:20.215616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:26:20.215914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] PATH_INFO: `/v3/projects/c18e26eb07ee4b088e003d47ce755c90` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:26:20.226557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18e26eb07ee4b088e003d47ce755c90)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:26:20.227612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:26:20.227612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:26:20.227612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:26:20.228810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:26:20.365471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18e26eb07ee4b088e003d47ce755c90', 'request_id': 'req-14fc5870-bac1-4633-93f2-b9990d75d3d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:20.488282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18e26eb07ee4b088e003d47ce755c90', 'request_id': 'req-14fc5870-bac1-4633-93f2-b9990d75d3d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:20.495554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18e26eb07ee4b088e003d47ce755c90', 'request_id': 'req-14fc5870-bac1-4633-93f2-b9990d75d3d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:20.525814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] The token cache is being invalidate because project c18e26eb07ee4b088e003d47ce755c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:26:20.526103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:20.526541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14fc5870-bac1-4633-93f2-b9990d75d3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:26:20.528035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 765/1510] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:26:20 2022] DELETE /identity/v3/projects/c18e26eb07ee4b088e003d47ce755c90 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:26:29.683806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=62 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:26:30.523579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:14.211679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d49ec-4fc1-44f2-80d8-48e121e6d9a0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:14.212306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d49ec-4fc1-44f2-80d8-48e121e6d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:14.212306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d49ec-4fc1-44f2-80d8-48e121e6d9a0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:14.213650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:14.218662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594f36b-d35c-4e02-b548-4b993430b888 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:14.219120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594f36b-d35c-4e02-b548-4b993430b888 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:14.219232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594f36b-d35c-4e02-b548-4b993430b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:14.299100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a594f36b-d35c-4e02-b548-4b993430b888 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:14.300303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a594f36b-d35c-4e02-b548-4b993430b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:14.404891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:14.559102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d49ec-4fc1-44f2-80d8-48e121e6d9a0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:14.564050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0a9d49ec-4fc1-44f2-80d8-48e121e6d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:14.680040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d49ec-4fc1-44f2-80d8-48e121e6d9a0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:14.685764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cc9a1-2b30-4691-a28c-381b614b76a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:14.686403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cc9a1-2b30-4691-a28c-381b614b76a9 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:14.686714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cc9a1-2b30-4691-a28c-381b614b76a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:14.686997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cc9a1-2b30-4691-a28c-381b614b76a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:14.695830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cc9a1-2b30-4691-a28c-381b614b76a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:14.697409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cc9a1-2b30-4691-a28c-381b614b76a9 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:14.706865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 747/1513] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:15.545973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc732-b377-4e6b-8c3f-a140565271c4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:15.546488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc732-b377-4e6b-8c3f-a140565271c4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:15.546612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc732-b377-4e6b-8c3f-a140565271c4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:15.547985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:15.553466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50496a2-6270-4ddf-bdc6-86da1aef1a30 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:15.553902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50496a2-6270-4ddf-bdc6-86da1aef1a30 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:15.554007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50496a2-6270-4ddf-bdc6-86da1aef1a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:15.572647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e50496a2-6270-4ddf-bdc6-86da1aef1a30 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:15.573838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e50496a2-6270-4ddf-bdc6-86da1aef1a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:15.581967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:15.737911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc732-b377-4e6b-8c3f-a140565271c4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:15.753204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc732-b377-4e6b-8c3f-a140565271c4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:15.758659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309266b3-099a-4952-bb7c-89cde23dbd1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:15.759303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309266b3-099a-4952-bb7c-89cde23dbd1c service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:15.759584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309266b3-099a-4952-bb7c-89cde23dbd1c service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:15.759857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309266b3-099a-4952-bb7c-89cde23dbd1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:15.768440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309266b3-099a-4952-bb7c-89cde23dbd1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:15.769970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309266b3-099a-4952-bb7c-89cde23dbd1c service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:15.779733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 768/1516] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:16.841994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10df0f-4ff4-474c-bcea-890e4e1031eb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:16.842561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10df0f-4ff4-474c-bcea-890e4e1031eb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:16.842561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10df0f-4ff4-474c-bcea-890e4e1031eb None None] PATH_INFO: `/v3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:16.843880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 749/1517] 10.222.0.86 () {54 vars in 925 bytes} [Wed Jul 20 15:28:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:28:16.850736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27d04-f186-422e-b143-893d108286bf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:16.851177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27d04-f186-422e-b143-893d108286bf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:16.851287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c27d04-f186-422e-b143-893d108286bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:16.909683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-01c27d04-f186-422e-b143-893d108286bf None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:16.910902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01c27d04-f186-422e-b143-893d108286bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:16.928022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:16.982315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 769/1518] 10.222.0.86 () {58 vars in 1015 bytes} [Wed Jul 20 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:25.567917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=56 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:26.979556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=23 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:27.043507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad186752-5f3d-421b-a5be-4f4a625c359f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:27.044084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad186752-5f3d-421b-a5be-4f4a625c359f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:27.044084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad186752-5f3d-421b-a5be-4f4a625c359f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:27.045452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 750/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:27.050991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59140750-cfe2-404b-a03c-db042de8fa65 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:27.051303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59140750-cfe2-404b-a03c-db042de8fa65 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:27.051602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59140750-cfe2-404b-a03c-db042de8fa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:27.070963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-59140750-cfe2-404b-a03c-db042de8fa65 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:27.072404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-59140750-cfe2-404b-a03c-db042de8fa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:27.082007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 770/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:27.241098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad186752-5f3d-421b-a5be-4f4a625c359f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:27.256535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad186752-5f3d-421b-a5be-4f4a625c359f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:27.262202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c6140-2e63-4a46-8d2d-0b435aa585f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:27.262871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6140-2e63-4a46-8d2d-0b435aa585f7 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:27.263161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6140-2e63-4a46-8d2d-0b435aa585f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:27.263441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c6140-2e63-4a46-8d2d-0b435aa585f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:27.272617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6140-2e63-4a46-8d2d-0b435aa585f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:27.274236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c6140-2e63-4a46-8d2d-0b435aa585f7 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:27.284541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 751/1521] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:27.537963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119f65-a73e-446a-8cbf-b436b3e03ac0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:27.538258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119f65-a73e-446a-8cbf-b436b3e03ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:27.538758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119f65-a73e-446a-8cbf-b436b3e03ac0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:27.540172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 771/1522] 10.222.0.87 () {54 vars in 961 bytes} [Wed Jul 20 15:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:27.545369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121fb5-df28-46f0-a91d-0ac91162ddc1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:27.545762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121fb5-df28-46f0-a91d-0ac91162ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:27.546120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121fb5-df28-46f0-a91d-0ac91162ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:27.565112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-db121fb5-df28-46f0-a91d-0ac91162ddc1 None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:27.566401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-db121fb5-df28-46f0-a91d-0ac91162ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:27.575630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 752/1523] 10.222.0.87 () {58 vars in 1058 bytes} [Wed Jul 20 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:27.583803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad119f65-a73e-446a-8cbf-b436b3e03ac0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:27.597754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad119f65-a73e-446a-8cbf-b436b3e03ac0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:27.602753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100a43-af2a-4982-be05-4185b071d1ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:27.603390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100a43-af2a-4982-be05-4185b071d1ed service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:27.603677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100a43-af2a-4982-be05-4185b071d1ed service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:27.603957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100a43-af2a-4982-be05-4185b071d1ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:27.613066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba100a43-af2a-4982-be05-4185b071d1ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:27.614746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba100a43-af2a-4982-be05-4185b071d1ed service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:27.625121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 772/1524] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:28.120849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58803dbb-556a-4a37-8f4c-3707c336d7e4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:28.121410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58803dbb-556a-4a37-8f4c-3707c336d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:28.121410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58803dbb-556a-4a37-8f4c-3707c336d7e4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:28.122912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 15:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:28.128112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975423-bb49-4aab-ab0e-17b145464a09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:28.128540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975423-bb49-4aab-ab0e-17b145464a09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:28.128675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975423-bb49-4aab-ab0e-17b145464a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:28.146805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c3975423-bb49-4aab-ab0e-17b145464a09 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:28.148010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c3975423-bb49-4aab-ab0e-17b145464a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:28.156158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 15:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:28.315000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58803dbb-556a-4a37-8f4c-3707c336d7e4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:28.329861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58803dbb-556a-4a37-8f4c-3707c336d7e4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:28.336229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca71e75-09bc-44f5-96ec-6af9848a86ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:28.336900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca71e75-09bc-44f5-96ec-6af9848a86ea service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:28.337186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca71e75-09bc-44f5-96ec-6af9848a86ea service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:28.337464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca71e75-09bc-44f5-96ec-6af9848a86ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:28.346696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca71e75-09bc-44f5-96ec-6af9848a86ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:28.348355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca71e75-09bc-44f5-96ec-6af9848a86ea service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:28.357753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 754/1527] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:32.517392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a669c-c8e5-4cea-96b8-186aa5e72873 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.518067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a669c-c8e5-4cea-96b8-186aa5e72873 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.518067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a669c-c8e5-4cea-96b8-186aa5e72873 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.519397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:32.524739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e7ed7-9bb3-43f0-929d-a2a76775ac71 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.525197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e7ed7-9bb3-43f0-929d-a2a76775ac71 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.525345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e7ed7-9bb3-43f0-929d-a2a76775ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.543921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-980e7ed7-9bb3-43f0-929d-a2a76775ac71 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:32.545107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-980e7ed7-9bb3-43f0-929d-a2a76775ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:32.553835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:32.629946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a669c-c8e5-4cea-96b8-186aa5e72873 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:32.631753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dd8a669c-c8e5-4cea-96b8-186aa5e72873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:32.709783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a669c-c8e5-4cea-96b8-186aa5e72873 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:32.713386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b8bb4-53cd-4520-aad3-f1a580f01088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:32.714029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b8bb4-53cd-4520-aad3-f1a580f01088 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:32.714314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b8bb4-53cd-4520-aad3-f1a580f01088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:32.714591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b8bb4-53cd-4520-aad3-f1a580f01088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:32.723576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b8bb4-53cd-4520-aad3-f1a580f01088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:32.725003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b8bb4-53cd-4520-aad3-f1a580f01088 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:32.734290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 775/1530] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:34.792510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669f01-077d-4dbc-9807-13a50a2a94ec None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.793059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669f01-077d-4dbc-9807-13a50a2a94ec None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.793059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669f01-077d-4dbc-9807-13a50a2a94ec None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.794654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:28:34.799872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb81f-799b-44a7-8c13-f801124777fa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.800288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb81f-799b-44a7-8c13-f801124777fa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.800429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb81f-799b-44a7-8c13-f801124777fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.818163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-331bb81f-799b-44a7-8c13-f801124777fa None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:34.819381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-331bb81f-799b-44a7-8c13-f801124777fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:34.827198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:34.864553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d669f01-077d-4dbc-9807-13a50a2a94ec None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:34.875603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d669f01-077d-4dbc-9807-13a50a2a94ec None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:34.879249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b555e-8c63-45c4-ba75-d8872883bb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:34.879901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b555e-8c63-45c4-ba75-d8872883bb7e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:34.880214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b555e-8c63-45c4-ba75-d8872883bb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:34.880526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b555e-8c63-45c4-ba75-d8872883bb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:34.889394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b555e-8c63-45c4-ba75-d8872883bb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:34.890864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b555e-8c63-45c4-ba75-d8872883bb7e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:34.901507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 757/1533] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:38.452260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074259f-9a1c-4e2c-b0ce-abe9428feccb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.452877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074259f-9a1c-4e2c-b0ce-abe9428feccb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.452877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074259f-9a1c-4e2c-b0ce-abe9428feccb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.454204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:38.459663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c39c-9d68-4d93-91a7-4d4a950f994d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.460112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c39c-9d68-4d93-91a7-4d4a950f994d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.460217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c39c-9d68-4d93-91a7-4d4a950f994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.478151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5ce4c39c-9d68-4d93-91a7-4d4a950f994d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:38.479385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5ce4c39c-9d68-4d93-91a7-4d4a950f994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.487953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:38.794630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074259f-9a1c-4e2c-b0ce-abe9428feccb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:38.796449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f074259f-9a1c-4e2c-b0ce-abe9428feccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:38.876551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074259f-9a1c-4e2c-b0ce-abe9428feccb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:38.880252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4446df-3e3f-46c8-9b4c-327dfd1bb3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:38.880938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4446df-3e3f-46c8-9b4c-327dfd1bb3fe service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:38.881227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4446df-3e3f-46c8-9b4c-327dfd1bb3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:38.881510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4446df-3e3f-46c8-9b4c-327dfd1bb3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:38.890552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4446df-3e3f-46c8-9b4c-327dfd1bb3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:38.892018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4446df-3e3f-46c8-9b4c-327dfd1bb3fe service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:38.902110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 778/1536] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:40.978065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36197b7-d1e5-4b25-a319-5ff5df2f364d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:40.978705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36197b7-d1e5-4b25-a319-5ff5df2f364d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:40.978705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36197b7-d1e5-4b25-a319-5ff5df2f364d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:40.980019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 15:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:28:40.985113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e899-91ff-4fae-bdeb-834870ac22d1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:40.985562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e899-91ff-4fae-bdeb-834870ac22d1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:40.985667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e899-91ff-4fae-bdeb-834870ac22d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:41.004348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b285e899-91ff-4fae-bdeb-834870ac22d1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:28:41.005546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b285e899-91ff-4fae-bdeb-834870ac22d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:41.013484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:28:41.318347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36197b7-d1e5-4b25-a319-5ff5df2f364d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:28:41.320038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b36197b7-d1e5-4b25-a319-5ff5df2f364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:28:41.333075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36197b7-d1e5-4b25-a319-5ff5df2f364d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:28:41.336584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5be40-24a4-4f7d-a27c-52d2f644d396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:28:41.337217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5be40-24a4-4f7d-a27c-52d2f644d396 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:28:41.337522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5be40-24a4-4f7d-a27c-52d2f644d396 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:28:41.337780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5be40-24a4-4f7d-a27c-52d2f644d396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:28:41.347238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5be40-24a4-4f7d-a27c-52d2f644d396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:28:41.348659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5be40-24a4-4f7d-a27c-52d2f644d396 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:28:41.358010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 760/1539] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:28:50.998786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:28:51.353820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=33 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:22.464921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d115-3e00-4b83-93ba-cbdb02c17735 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.467278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d115-3e00-4b83-93ba-cbdb02c17735 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.467278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d115-3e00-4b83-93ba-cbdb02c17735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.488176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-40c7d115-3e00-4b83-93ba-cbdb02c17735 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:22.489745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-40c7d115-3e00-4b83-93ba-cbdb02c17735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:22.501593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 780/1540] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:22.517100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20e8a-96ce-443f-ac95-5b66c6b1f565 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.518393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20e8a-96ce-443f-ac95-5b66c6b1f565 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.518940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20e8a-96ce-443f-ac95-5b66c6b1f565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.548008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-37f20e8a-96ce-443f-ac95-5b66c6b1f565 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:22.550345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-37f20e8a-96ce-443f-ac95-5b66c6b1f565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:22.560231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 761/1541] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:22.565262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d115-3e00-4b83-93ba-cbdb02c17735 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.579167 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d115-3e00-4b83-93ba-cbdb02c17735 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.588735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.590081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.590614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.591167 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.592253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:22.592802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.594816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.610256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 781/1542] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:22.619207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20e8a-96ce-443f-ac95-5b66c6b1f565 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.630379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20e8a-96ce-443f-ac95-5b66c6b1f565 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.643433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdee64-8fd8-4a98-a8c9-8d34fec7db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.644525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdee64-8fd8-4a98-a8c9-8d34fec7db55 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.645658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdee64-8fd8-4a98-a8c9-8d34fec7db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.646156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdee64-8fd8-4a98-a8c9-8d34fec7db55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.647145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdee64-8fd8-4a98-a8c9-8d34fec7db55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.649374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdee64-8fd8-4a98-a8c9-8d34fec7db55 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.764000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 762/1543] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:22.768796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.784406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801e40f-fadb-4371-b477-34fe508e4417 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:22.868465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:22.869586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.870108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.870616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.871666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:22.873908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:22.907149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd44fe-e207-413b-9afc-7ae26ecdf114 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.908523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd44fe-e207-413b-9afc-7ae26ecdf114 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.908523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd44fe-e207-413b-9afc-7ae26ecdf114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.929586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fdfd44fe-e207-413b-9afc-7ae26ecdf114 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:22.931220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fdfd44fe-e207-413b-9afc-7ae26ecdf114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:22.943525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 763/1544] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:22.952446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0663-5aa8-4f12-bb0c-fc630c87dc2f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:22.954590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0663-5aa8-4f12-bb0c-fc630c87dc2f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:22.954590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0663-5aa8-4f12-bb0c-fc630c87dc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:22.979610 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 782/1545] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:22.983339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-46eb0663-5aa8-4f12-bb0c-fc630c87dc2f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:22.988852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:22.989020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-46eb0663-5aa8-4f12-bb0c-fc630c87dc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:22.998559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 764/1546] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.000700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c9d-7c3b-43f0-8b6e-c4c2cdf3b084 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.007434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0663-5aa8-4f12-bb0c-fc630c87dc2f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.012676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.013363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.013643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.013917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.014723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.017088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.020890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0663-5aa8-4f12-bb0c-fc630c87dc2f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.041563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 783/1547] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:23.043782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.044486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.044771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.047363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.048464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.048605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:23.048605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.049271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:30:23.049271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 20 15:30:23.049271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: Jul 20 15:30:23.050340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.069809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a47ad-ec7b-4a86-a46e-de24f31483f0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.082451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.083331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.083611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.083884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.084617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.085093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 765/1548] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:30:23.086985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.097404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.110109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 784/1549] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:23.115270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.117864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f237-322e-4a63-a177-448cda6b53fb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.130287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54018c9-069c-4e5c-af44-a06fcf8602cb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.132904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69890a-0eac-470f-ac44-f327978753e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.133578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69890a-0eac-470f-ac44-f327978753e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.133871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69890a-0eac-470f-ac44-f327978753e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.134139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69890a-0eac-470f-ac44-f327978753e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.134869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69890a-0eac-470f-ac44-f327978753e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.136794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69890a-0eac-470f-ac44-f327978753e9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.148690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13854d72-9f3c-4443-b1c5-f4165769dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.149605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854d72-9f3c-4443-b1c5-f4165769dc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.149884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854d72-9f3c-4443-b1c5-f4165769dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.150168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854d72-9f3c-4443-b1c5-f4165769dc43 admin admin] PATH_INFO: `/v3/projects/e618f8d750bd41a3a9b8b7c49e4c9d12/users/bd670021e19d468da5e949204a1006e8/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.182506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13854d72-9f3c-4443-b1c5-f4165769dc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618f8d750bd41a3a9b8b7c49e4c9d12, user_id=bd670021e19d468da5e949204a1006e8, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.183601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-13854d72-9f3c-4443-b1c5-f4165769dc43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:30:23.183601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:30:23.183601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:30:23.185757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13854d72-9f3c-4443-b1c5-f4165769dc43 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.313831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 766/1550] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:23.315329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f097e5-3f82-4f66-847f-0f647aedf0d3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.315732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f097e5-3f82-4f66-847f-0f647aedf0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.316218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f097e5-3f82-4f66-847f-0f647aedf0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.335835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b4f097e5-3f82-4f66-847f-0f647aedf0d3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.337034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b4f097e5-3f82-4f66-847f-0f647aedf0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.373431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 785/1551] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:23 2022] PUT /identity/v3/projects/e618f8d750bd41a3a9b8b7c49e4c9d12/users/bd670021e19d468da5e949204a1006e8/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:23.374850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9fa4-973d-4938-b6d1-f842ee91c561 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.375239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9fa4-973d-4938-b6d1-f842ee91c561 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.375521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9fa4-973d-4938-b6d1-f842ee91c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.393522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-22ed9fa4-973d-4938-b6d1-f842ee91c561 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.398763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-22ed9fa4-973d-4938-b6d1-f842ee91c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.401453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 767/1552] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.402775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f4be-1ce9-4f9a-befa-c35b422d81c4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.403068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f4be-1ce9-4f9a-befa-c35b422d81c4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.403350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54f4be-1ce9-4f9a-befa-c35b422d81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.422459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7e54f4be-1ce9-4f9a-befa-c35b422d81c4 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.423682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7e54f4be-1ce9-4f9a-befa-c35b422d81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.459698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 786/1553] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.460994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1caef6-b50b-4bc7-9f2b-668d9aaf8a7d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.461284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1caef6-b50b-4bc7-9f2b-668d9aaf8a7d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.461561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1caef6-b50b-4bc7-9f2b-668d9aaf8a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.479884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dc1caef6-b50b-4bc7-9f2b-668d9aaf8a7d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.481087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc1caef6-b50b-4bc7-9f2b-668d9aaf8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.483959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 768/1554] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.484770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f4be-1ce9-4f9a-befa-c35b422d81c4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.494318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54f4be-1ce9-4f9a-befa-c35b422d81c4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.496898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 787/1555] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.498228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca922-6d10-4231-a3e4-ddaf309883fc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.498667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca922-6d10-4231-a3e4-ddaf309883fc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.498965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca922-6d10-4231-a3e4-ddaf309883fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.500117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74543-5ef4-417d-94e1-ab0e50acee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.500832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74543-5ef4-417d-94e1-ab0e50acee1d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.501249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74543-5ef4-417d-94e1-ab0e50acee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.501534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74543-5ef4-417d-94e1-ab0e50acee1d admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.502871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74543-5ef4-417d-94e1-ab0e50acee1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.503901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-b4d74543-5ef4-417d-94e1-ab0e50acee1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:30:23.503901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 20 15:30:23.503901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: Jul 20 15:30:23.505117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74543-5ef4-417d-94e1-ab0e50acee1d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.519463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-428ca922-6d10-4231-a3e4-ddaf309883fc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.520695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-428ca922-6d10-4231-a3e4-ddaf309883fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.529187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 788/1556] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.530453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62838-e565-426c-992a-5d7c393598e2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.530777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62838-e565-426c-992a-5d7c393598e2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.531150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e62838-e565-426c-992a-5d7c393598e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.550228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-07e62838-e565-426c-992a-5d7c393598e2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.551449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-07e62838-e565-426c-992a-5d7c393598e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.559673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 789/1557] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.564399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bccf-8ce3-4b9e-88bf-70fb534a84f2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.564399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bccf-8ce3-4b9e-88bf-70fb534a84f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.564399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bccf-8ce3-4b9e-88bf-70fb534a84f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.570440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:23.590629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2ae2bccf-8ce3-4b9e-88bf-70fb534a84f2 None None] MFA Rules not processed for user `bd670021e19d468da5e949204a1006e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.596859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2ae2bccf-8ce3-4b9e-88bf-70fb534a84f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.613519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:23.622566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 769/1558] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:23.622566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b171fa4-a4d1-4cd7-84af-137c6892ae7b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.622566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b171fa4-a4d1-4cd7-84af-137c6892ae7b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.622566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b171fa4-a4d1-4cd7-84af-137c6892ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.638731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0b171fa4-a4d1-4cd7-84af-137c6892ae7b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.640274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0b171fa4-a4d1-4cd7-84af-137c6892ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.649259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 770/1559] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.650491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb02fd5-4425-4e40-9208-811603f1b0bd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.650923 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb02fd5-4425-4e40-9208-811603f1b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.651210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb02fd5-4425-4e40-9208-811603f1b0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.661757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 790/1560] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.663625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd346-c4b4-4042-8c18-060596edf64f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.664571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd346-c4b4-4042-8c18-060596edf64f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.665165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd346-c4b4-4042-8c18-060596edf64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.670085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fcb02fd5-4425-4e40-9208-811603f1b0bd None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.671313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fcb02fd5-4425-4e40-9208-811603f1b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.679611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 771/1561] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.680699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad4212-738e-4db4-a608-47e5f7fc48be None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.681386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad4212-738e-4db4-a608-47e5f7fc48be None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.681993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad4212-738e-4db4-a608-47e5f7fc48be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.683341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e72cd346-c4b4-4042-8c18-060596edf64f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.684527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e72cd346-c4b4-4042-8c18-060596edf64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.693270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 791/1562] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.694572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845b4b-f9f7-4e48-b498-5fcc7e291fcb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.694906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845b4b-f9f7-4e48-b498-5fcc7e291fcb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.695180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845b4b-f9f7-4e48-b498-5fcc7e291fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.700291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-57ad4212-738e-4db4-a608-47e5f7fc48be None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.701493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-57ad4212-738e-4db4-a608-47e5f7fc48be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.710091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 772/1563] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.711383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d946f-7b21-4e05-998c-c71c344f43b2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.711669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d946f-7b21-4e05-998c-c71c344f43b2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.711946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d946f-7b21-4e05-998c-c71c344f43b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.715107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3c845b4b-f9f7-4e48-b498-5fcc7e291fcb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.716354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3c845b4b-f9f7-4e48-b498-5fcc7e291fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.727858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 792/1564] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.728736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c845b4b-f9f7-4e48-b498-5fcc7e291fcb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.730909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4b9d946f-7b21-4e05-998c-c71c344f43b2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:23.732424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b9d946f-7b21-4e05-998c-c71c344f43b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:23.739323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c845b4b-f9f7-4e48-b498-5fcc7e291fcb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.740928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 773/1565] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:23.741765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d946f-7b21-4e05-998c-c71c344f43b2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.744025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.744889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.745176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.745449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.746178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.747808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.751529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d946f-7b21-4e05-998c-c71c344f43b2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.756197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.756842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.757129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.757409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.760857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 793/1566] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:23.760993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:23.760993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.763004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.763129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.771212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab42d4-ece2-4c68-9c0b-e5a7535a8355 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.773069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 774/1567] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:23.773866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.778026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.779118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.779483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.779836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.780862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.782030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:30:23.782030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:30:23.782030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:30:23.783914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.784827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234afd8d-d671-49d9-9e2f-9063f8cc0981 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.790203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.790880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.791167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.791449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.792197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:23.792534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.794143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.807120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 775/1568] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:23.807922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.820219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee624-a0d7-42b3-95ff-0729d91a5d38 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.823594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.824231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.824516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.824794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.825520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:23.825832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.827537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.839807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 776/1569] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:23.840695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.852287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aa3f8-32b2-4207-811c-b0af6f7146d6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.857073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.865671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.865671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.865671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.865671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:23.865671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.865671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.874659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 777/1570] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:23.875459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.886074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f1b84-7b36-4397-b434-3f15a4b74195 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.888994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 794/1571] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:23.889706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.893370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.894092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.894465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.894838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.895644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:23.900686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.900686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.910838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 778/1572] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:23.911925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.922078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485f967-e099-4ab4-b11b-b968acb9a007 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.962837 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fe87e-f31c-4e3f-b40b-9b1c3e6923c2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.967695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.975007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.975007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.975007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.975007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:23.975007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.975007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.980030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:23.980702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:23.981511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:23.981793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:23.982523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:23.984150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:23.984280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 795/1573] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:23.984973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:23.996446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd7ae-f0a3-4e63-b0d4-307cdd64d643 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:23.999450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 779/1574] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:23.999450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.009480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.009480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.009480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.009480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.009807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.009807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.009957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483726f5-cd11-4c7d-bcb6-564ff503a763 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.015195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.016330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.016611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.016885 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.018702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.020610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.112042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 796/1575] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.112906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.133673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:24.134951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 780/1576] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:23 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.135659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.175431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32b94d-21f5-4644-a85b-729349c84fd8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.180152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:24.199446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c485a56-5933-410e-9007-a54c8e744b4e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.204132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.204835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.205129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.206184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.207192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.210249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.232304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.233056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.233345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.233627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.234354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.236316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.330852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 781/1577] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.330852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.370076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 797/1578] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.370076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.394186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bd65d-2147-485f-9f8b-467849cba591 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.428244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a9811-f555-4b8e-96c3-029204c20af4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.433219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.433919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.434204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.434673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.435507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.437338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.452000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.452677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.453059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.453310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.454032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.456559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.544851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 782/1579] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.544851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.548127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 798/1580] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.548127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.555914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f9201-6e3f-4dcf-8965-a9886a3fa075 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.593441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:24.613470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.614163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.614759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.614860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.614942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21fca-a251-42fa-b22e-b09b59e74119 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.615550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.617465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.619596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.620534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.620759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.621037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] PATH_INFO: `/v3/projects/0663e49807df40e998bb8bc388ea863d/users/f004a4778f7d46119108b09bdccb8739/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.621716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:24.635390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0663e49807df40e998bb8bc388ea863d, user_id=f004a4778f7d46119108b09bdccb8739, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.638029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.735637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 783/1581] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/projects => generated 393 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.735637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.750182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 799/1582] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:24 2022] PUT /identity/v3/projects/0663e49807df40e998bb8bc388ea863d/users/f004a4778f7d46119108b09bdccb8739/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:24.751241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.798936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5493783-7af7-4063-9ac5-c0dee2770415 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.812852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c86e-71a8-4c26-bc07-31cf9a3cc611 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.818921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.819606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.819892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.820166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.820884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.822833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.856376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.857073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.857359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.857667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.858352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.860322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.938661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 800/1583] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.939946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.949347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48951c56-f299-468f-9aca-d84108dc7acd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.953945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.954587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.954899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.955792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.956468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.958374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:24.970087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 784/1584] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:24.970087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:24.977970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcda3af-c2e6-417e-9ebe-459f1ab7b423 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:24.982493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:24.983185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:24.983470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:24.983747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:24.984426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:24.986358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.041469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 801/1585] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:25.044662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.052463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db513681-13dc-4959-83e3-c8d9ab8b5b0a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.057001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.057641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.057924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.058211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.058964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.060552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.070997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 802/1586] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.071881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.081191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367824a-77eb-418e-9c5b-1b26832e0bf8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.085766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e51715-70e0-4209-8d1d-604a4e351d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.086361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e51715-70e0-4209-8d1d-604a4e351d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.086665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e51715-70e0-4209-8d1d-604a4e351d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.086959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e51715-70e0-4209-8d1d-604a4e351d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.087633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e51715-70e0-4209-8d1d-604a4e351d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.089504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e51715-70e0-4209-8d1d-604a4e351d38 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.096463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 785/1587] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:24 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:25.096463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.104869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d610-42e1-4a03-92ea-d5caa7a9fb06 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.109654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.110311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.110596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.110908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.112212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.114218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.180575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 803/1588] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:25 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:25.182103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ff8a-dcc8-49b1-85d8-4a03fb66065e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.182391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ff8a-dcc8-49b1-85d8-4a03fb66065e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.182693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ff8a-dcc8-49b1-85d8-4a03fb66065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.201732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7f32ff8a-dcc8-49b1-85d8-4a03fb66065e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:25.202892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7f32ff8a-dcc8-49b1-85d8-4a03fb66065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:25.207851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 786/1589] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:25 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:25.209028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.211880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 804/1590] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:25.213003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ff8a-dcc8-49b1-85d8-4a03fb66065e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.220256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab711d4a-df7b-4cab-870c-6e7cbf809f20 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.224130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ff8a-dcc8-49b1-85d8-4a03fb66065e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.225516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.226218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.226506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.226817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.227587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.228660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.229179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.229320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.229634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.229908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.230630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.232235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.240901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 787/1591] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.243551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 805/1592] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.244860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.244984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.255834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb985f-437f-41a4-b461-4e76e36c60ef admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.256710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d0f42-ddd3-4657-8398-f6a7ae503db3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.260436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.261256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.261386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.261596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.261894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] PATH_INFO: `/v3/projects/157b520344fc4bb194805618af8581d4/users/1d5ca1a1d76c411bbd4f1e36cfc5c891/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.262038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.262196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.262447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.263210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.264794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.275250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 788/1593] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.276038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.277064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157b520344fc4bb194805618af8581d4, user_id=1d5ca1a1d76c411bbd4f1e36cfc5c891, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.280099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.286109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0446f63-f35b-4ee7-b31d-687d899dacd8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.290762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.291413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.291703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.291982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.292702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.294278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.304875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 789/1594] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.305787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.315763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0028c-0b43-4e31-9eae-11cedcda2b86 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.320306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.320920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.321207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.321488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.322188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.323770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.333947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 790/1595] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.334806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.340645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:25.344298 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2cfe5-0dbd-4da2-a663-a49de8e2ba98 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.348975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.349626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.349910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.350189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.350922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.352566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.362823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 806/1596] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:25 2022] PUT /identity/v3/projects/157b520344fc4bb194805618af8581d4/users/1d5ca1a1d76c411bbd4f1e36cfc5c891/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:25.365590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.365708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 791/1597] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.365708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.375378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d9402-2268-4980-a3f0-df17afd338b8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.389909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:25.419353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e148aa-5772-4d75-90e5-a95cfe399174 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.423281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.424600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.424928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.425214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.433650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.434382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.434827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.435115 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.435843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.437431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.447370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 792/1598] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.448159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.457688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afebcec-ddae-45fe-9422-b64441d8d055 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.462258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.462936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.463219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.463495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.464206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.465788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.478063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 793/1599] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.478904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.489268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb36d00-156b-4569-9fb4-9699caa0b53c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.490746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.492233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.494714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.495378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.495660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.495933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.496650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.498228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.502887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 807/1600] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:25.503732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.513249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e36a52-6552-40f6-b758-fab79a65d470 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.517439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 794/1601] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.517439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.523263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.523263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.523503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.523632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.524354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.526139 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.526583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecd382-3406-43f0-b94f-ca8355f17075 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.531811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.532468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.532747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.533025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.534504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.536121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.537215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 808/1602] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.538059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.549515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2706b4-d6e4-43ee-be08-004ca4cc5601 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.552568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 795/1603] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.552568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.556202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.556202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.556202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.556202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.556673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.558270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.562268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c65f79-662b-4d39-bd09-21a965997510 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.568218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.568861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.569140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.569416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.569831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 809/1604] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.570197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.570480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.571809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.580706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd9ba4-0f71-4230-855a-2ca95c7e424c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.584429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 796/1605] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:25.584429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.585609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.590393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.590393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.590393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] PATH_INFO: `/v3/projects/593938010dbb4ef49efa9ab5f74c1ac2/users/cc17873bfe0542feae57ffe881cc1598/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.593299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a9a5d-cd42-4a30-a223-cf7ad15f1901 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.598580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.599493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.599773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.600117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] PATH_INFO: `/v3/projects/cb776c4e377848b2bbce72151c663ad2/users/a71a9f43fc024c188e6b5285b9d81c4c/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.604050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593938010dbb4ef49efa9ab5f74c1ac2, user_id=cc17873bfe0542feae57ffe881cc1598, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.606787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.615763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb776c4e377848b2bbce72151c663ad2, user_id=a71a9f43fc024c188e6b5285b9d81c4c, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.622947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.726195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 810/1606] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:25 2022] PUT /identity/v3/projects/593938010dbb4ef49efa9ab5f74c1ac2/users/cc17873bfe0542feae57ffe881cc1598/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:25.726195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.750295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 797/1607] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:25 2022] PUT /identity/v3/projects/cb776c4e377848b2bbce72151c663ad2/users/a71a9f43fc024c188e6b5285b9d81c4c/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:25.751419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.787237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69420599-ea0e-4adf-adb1-de78b0f01814 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.819204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23c97-f509-4fb9-b841-dc39c823c6d0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:25.822684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:25.824145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.825041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.825322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.825650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] PATH_INFO: `/v3/projects/d0aada6b8c2b45e49ceb2bb8a039d828/users/0745a6ca3e464ac9ac58ca1e21f3a7cf/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.844036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0aada6b8c2b45e49ceb2bb8a039d828, user_id=0745a6ca3e464ac9ac58ca1e21f3a7cf, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.848421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.850922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:25.860631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:25.860631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:25.860631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] PATH_INFO: `/v3/projects/1853181542f348a2836311e1bcabc644/users/2ba70ecaeab14d0b827defc52f87a210/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:25.868847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1853181542f348a2836311e1bcabc644, user_id=2ba70ecaeab14d0b827defc52f87a210, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:25.871554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:25.979364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 798/1608] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:25 2022] PUT /identity/v3/projects/d0aada6b8c2b45e49ceb2bb8a039d828/users/0745a6ca3e464ac9ac58ca1e21f3a7cf/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:25.980096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:25.985202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:26.015138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 811/1609] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:25 2022] PUT /identity/v3/projects/1853181542f348a2836311e1bcabc644/users/2ba70ecaeab14d0b827defc52f87a210/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:26.016122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.059996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb52b-2fa7-43aa-94d2-34921e6523f6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.098775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8acae1-5ab9-428e-bbae-72d2af3c020f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.103810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.104818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.105180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.105593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] PATH_INFO: `/v3/projects/157b520344fc4bb194805618af8581d4/users/1d5ca1a1d76c411bbd4f1e36cfc5c891/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.107624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=157b520344fc4bb194805618af8581d4, user_id=1d5ca1a1d76c411bbd4f1e36cfc5c891, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.110573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.122604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 812/1610] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:26 2022] PUT /identity/v3/projects/157b520344fc4bb194805618af8581d4/users/1d5ca1a1d76c411bbd4f1e36cfc5c891/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:26.128507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.129351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e9021-1b0f-47ed-a5b3-d2ac924a73a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.130621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e9021-1b0f-47ed-a5b3-d2ac924a73a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.131142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e9021-1b0f-47ed-a5b3-d2ac924a73a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.131686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e9021-1b0f-47ed-a5b3-d2ac924a73a3 admin admin] PATH_INFO: `/v3/projects/113db904c27a411ea9ccf082b883da86/users/760a7a314a9c4a788e751ce19c13ff93/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.152711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e9021-1b0f-47ed-a5b3-d2ac924a73a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113db904c27a411ea9ccf082b883da86, user_id=760a7a314a9c4a788e751ce19c13ff93, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.155840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e9021-1b0f-47ed-a5b3-d2ac924a73a3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.202400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c9834-6a28-41fd-9f0a-1c066d07c07b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.208150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab4095-ecbe-4e34-b600-3f87365bc16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.210129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab4095-ecbe-4e34-b600-3f87365bc16e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.210129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab4095-ecbe-4e34-b600-3f87365bc16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.210129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab4095-ecbe-4e34-b600-3f87365bc16e admin admin] PATH_INFO: `/v3/projects/83fc25cdd57f4c10831269921b420f70/users/96fa33ffb9e74daa8e5a4223176ba94f/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.223775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab4095-ecbe-4e34-b600-3f87365bc16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fc25cdd57f4c10831269921b420f70, user_id=96fa33ffb9e74daa8e5a4223176ba94f, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.226468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab4095-ecbe-4e34-b600-3f87365bc16e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.282279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 799/1611] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:25 2022] PUT /identity/v3/projects/113db904c27a411ea9ccf082b883da86/users/760a7a314a9c4a788e751ce19c13ff93/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:26.283603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77536b-ea71-486f-b592-b81331fcdef1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.283603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77536b-ea71-486f-b592-b81331fcdef1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.284160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77536b-ea71-486f-b592-b81331fcdef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.300850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1f77536b-ea71-486f-b592-b81331fcdef1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:26.302046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1f77536b-ea71-486f-b592-b81331fcdef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.312034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 813/1612] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:26 2022] PUT /identity/v3/projects/83fc25cdd57f4c10831269921b420f70/users/96fa33ffb9e74daa8e5a4223176ba94f/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:26.316563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef1ff-2c5b-433c-84b5-f72e75ad287f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.316865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef1ff-2c5b-433c-84b5-f72e75ad287f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.317153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef1ff-2c5b-433c-84b5-f72e75ad287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.350525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a23ef1ff-2c5b-433c-84b5-f72e75ad287f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:26.352827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a23ef1ff-2c5b-433c-84b5-f72e75ad287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.371479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 800/1613] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:26.372785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2653-228d-4875-bc85-9030a36c6246 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.373073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2653-228d-4875-bc85-9030a36c6246 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.373351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2653-228d-4875-bc85-9030a36c6246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.394121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:26.404449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-396c2653-228d-4875-bc85-9030a36c6246 None None] MFA Rules not processed for user `0745a6ca3e464ac9ac58ca1e21f3a7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:26.405934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-396c2653-228d-4875-bc85-9030a36c6246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.430056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 814/1614] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:26.431734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42eca-2753-467a-b9fd-43fdc757f790 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.432267 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42eca-2753-467a-b9fd-43fdc757f790 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.432787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42eca-2753-467a-b9fd-43fdc757f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.436471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:26.462716 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-28b42eca-2753-467a-b9fd-43fdc757f790 None None] MFA Rules not processed for user `2ba70ecaeab14d0b827defc52f87a210`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:26.463943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-28b42eca-2753-467a-b9fd-43fdc757f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.487050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 801/1615] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:26.487050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.487050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.487050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.516268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] MFA Rules not processed for user `1d5ca1a1d76c411bbd4f1e36cfc5c891`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:26.520876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.544777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 815/1616] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:26.546998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5ebd5-5207-4897-a861-e8b58ba54456 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.547298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5ebd5-5207-4897-a861-e8b58ba54456 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.547583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5ebd5-5207-4897-a861-e8b58ba54456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.566771 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5af5ebd5-5207-4897-a861-e8b58ba54456 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:26.568061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5af5ebd5-5207-4897-a861-e8b58ba54456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.583514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 816/1617] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:26.585180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.585537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.585885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.602333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 802/1618] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:26.603594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.605082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.614131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:26.618820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.628773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 817/1619] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:26.629752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.631196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:26.671133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4ce6-4ce9-4188-89ea-bd3eac37bd86 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.677238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.678043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.678329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.678609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.689177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.691482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.696013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75855b5-f6e2-4141-8044-8374cbf360a9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.699758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88d539-459a-4493-8e50-7060509dab97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.703049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d539-459a-4493-8e50-7060509dab97 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.703049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d539-459a-4493-8e50-7060509dab97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.703049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88d539-459a-4493-8e50-7060509dab97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.703435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 803/1620] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:26.703435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.711309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88d539-459a-4493-8e50-7060509dab97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.712175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94acaa-bdfd-4597-99a6-336b1b037a5e service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.712799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88d539-459a-4493-8e50-7060509dab97 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.717044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275e89d-59fe-4d0b-968d-4225d0bd48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.717704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275e89d-59fe-4d0b-968d-4225d0bd48c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.717999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275e89d-59fe-4d0b-968d-4225d0bd48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.718276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275e89d-59fe-4d0b-968d-4225d0bd48c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.719003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275e89d-59fe-4d0b-968d-4225d0bd48c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.720947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275e89d-59fe-4d0b-968d-4225d0bd48c6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.723514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 818/1621] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:26.725353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00308d-a658-4d34-842a-38b36c549278 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.725641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00308d-a658-4d34-842a-38b36c549278 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.725934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00308d-a658-4d34-842a-38b36c549278 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.727535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 819/1622] 10.222.0.87 () {54 vars in 962 bytes} [Wed Jul 20 15:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:30:26.731972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00308d-a658-4d34-842a-38b36c549278 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.744957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00308d-a658-4d34-842a-38b36c549278 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.748958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.749616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.749912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.750205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.769002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.770493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.781353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 820/1623] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:26.782005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.828400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:26.841527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c6654-753c-4c92-a472-451fa3f6b25b service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:26.846950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:26.846950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.846950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.846950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.856017 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:26.857466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:26.867724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 821/1624] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:26.868351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:26.882354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 804/1625] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:26.883880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b51a-8eae-42b5-9968-f155da036e94 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:26.884109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b51a-8eae-42b5-9968-f155da036e94 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:26.884387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1b51a-8eae-42b5-9968-f155da036e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:26.903115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a480c28-407e-4524-872f-60e008a5c9db service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.058503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-42f1b51a-8eae-42b5-9968-f155da036e94 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:27.058503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-42f1b51a-8eae-42b5-9968-f155da036e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:27.058503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:27.062479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.062479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.062479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.062479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.074227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 805/1626] 10.222.0.87 () {58 vars in 1059 bytes} [Wed Jul 20 15:30:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:27.075222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1b51a-8eae-42b5-9968-f155da036e94 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:27.181502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.184573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.205597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 822/1627] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:27.205597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:27.207907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1b51a-8eae-42b5-9968-f155da036e94 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.224842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808a6b-23db-4e44-9d4d-0850650dc520 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.231911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.234745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.245431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.245431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.245431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.245431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.246181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.257879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.259047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.259522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.365483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 806/1628] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:27 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:27.369480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:27.394795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e050a-0508-4d3f-b2f3-37498890f293 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.410336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.414297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.415448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.415597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.418403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.422214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.433419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.441952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.453784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 807/1629] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:30:27.459937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:27.470877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 823/1630] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:27.478932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c202e8-9bb0-4c40-814b-e6ae1ed44de1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.485066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f257f-9770-4b69-b547-8b605fe3bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.489188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f257f-9770-4b69-b547-8b605fe3bf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.493747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f257f-9770-4b69-b547-8b605fe3bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.493747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f257f-9770-4b69-b547-8b605fe3bf2e admin admin] PATH_INFO: `/v3/projects/8fd1d5a5692040aebb14a273ba20938b/users/8ea95968cf10467b8adaf2c40b8d4759/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.525016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f257f-9770-4b69-b547-8b605fe3bf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1d5a5692040aebb14a273ba20938b, user_id=8ea95968cf10467b8adaf2c40b8d4759, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.528336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f257f-9770-4b69-b547-8b605fe3bf2e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.717518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 808/1631] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:27 2022] PUT /identity/v3/projects/8fd1d5a5692040aebb14a273ba20938b/users/8ea95968cf10467b8adaf2c40b8d4759/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:27.721389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:27.747967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daad3a-c0eb-4826-98e4-c4dec1aa3f57 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.795250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:27.832938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.834519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.835059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.835537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccf48-3241-47f6-b6c9-7aa0fed29f19 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.835811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.835931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccf48-3241-47f6-b6c9-7aa0fed29f19 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.836105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ccf48-3241-47f6-b6c9-7aa0fed29f19 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.837217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.837715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 809/1632] 10.222.0.87 () {54 vars in 912 bytes} [Wed Jul 20 15:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:30:27.840228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.843049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4250-3979-418e-92f5-fbafd8b4f39d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.843890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4250-3979-418e-92f5-fbafd8b4f39d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.843890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4250-3979-418e-92f5-fbafd8b4f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.866271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 824/1633] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:27.867251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:27.873051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-efcd4250-3979-418e-92f5-fbafd8b4f39d None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:27.879800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86b19c-ae4a-474c-9f8c-963e919b1fa9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:27.889975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-efcd4250-3979-418e-92f5-fbafd8b4f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:27.892232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2986f-7bee-4fa7-8302-6fa49d90c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:27.894011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2986f-7bee-4fa7-8302-6fa49d90c396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.894294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2986f-7bee-4fa7-8302-6fa49d90c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.894573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2986f-7bee-4fa7-8302-6fa49d90c396 admin admin] PATH_INFO: `/v3/projects/8fd1d5a5692040aebb14a273ba20938b/users/8ea95968cf10467b8adaf2c40b8d4759/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:27.896641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2986f-7bee-4fa7-8302-6fa49d90c396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd1d5a5692040aebb14a273ba20938b, user_id=8ea95968cf10467b8adaf2c40b8d4759, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:27.899475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2986f-7bee-4fa7-8302-6fa49d90c396 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:27.936224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 825/1634] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:27 2022] PUT /identity/v3/projects/8fd1d5a5692040aebb14a273ba20938b/users/8ea95968cf10467b8adaf2c40b8d4759/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:27.938303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958b5f0-8f39-464d-a769-f0d9a5ff63c2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:27.938609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958b5f0-8f39-464d-a769-f0d9a5ff63c2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:27.938924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958b5f0-8f39-464d-a769-f0d9a5ff63c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:28.023744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1958b5f0-8f39-464d-a769-f0d9a5ff63c2 None None] MFA Rules not processed for user `8ea95968cf10467b8adaf2c40b8d4759`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:28.025493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1958b5f0-8f39-464d-a769-f0d9a5ff63c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:28.048668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:28.074492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 810/1635] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:28.092089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4250-3979-418e-92f5-fbafd8b4f39d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:28.250071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4250-3979-418e-92f5-fbafd8b4f39d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:28.251103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 826/1636] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:28.347371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:28.348055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:28.348356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:28.348803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:28.432256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:28.435657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:28.447732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958b5f0-8f39-464d-a769-f0d9a5ff63c2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:28.451056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 811/1637] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:28.455853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:28.468078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99db48e-0893-4ba1-b4c0-49917cd63be3 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:28.487519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:28.487519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:28.487519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:28.487519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:28.488120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:28.493780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:28.519289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 812/1638] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:28.568814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958b5f0-8f39-464d-a769-f0d9a5ff63c2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:28.574495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:28.576073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:28.576652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:28.577288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] PATH_INFO: `/v3/users/bd670021e19d468da5e949204a1006e8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:28.579791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd670021e19d468da5e949204a1006e8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:28.581846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:30:28.581846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 20 15:30:28.581846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: Jul 20 15:30:28.583961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:28.825906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:28.859749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:28.865520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd670021e19d468da5e949204a1006e8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:28.870416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca81d0-c164-476e-887e-d0ae5b589866 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:28.875439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef74be-2c3b-47d5-93a5-b71217c2a768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:28.876204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef74be-2c3b-47d5-93a5-b71217c2a768 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:28.876728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef74be-2c3b-47d5-93a5-b71217c2a768 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:28.877193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef74be-2c3b-47d5-93a5-b71217c2a768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:28.917172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd670021e19d468da5e949204a1006e8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:28.983398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef74be-2c3b-47d5-93a5-b71217c2a768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:28.985168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef74be-2c3b-47d5-93a5-b71217c2a768 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:29.001491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 813/1639] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:29.007595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:29.110408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd670021e19d468da5e949204a1006e8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:29.111966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd670021e19d468da5e949204a1006e8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:29.112950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd670021e19d468da5e949204a1006e8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:29.146373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 827/1640] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:28 2022] DELETE /identity/v3/users/bd670021e19d468da5e949204a1006e8 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:29.152583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:29.503801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:29.503801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:29.503801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:29.503801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:29.503801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 814/1641] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:29.504654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:29.504654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:29.504654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb74e4-8535-49de-aefa-e7adcb4e188d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:29.505918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322117d-e6a2-4813-ae4f-19d5327a2885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:29.505918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322117d-e6a2-4813-ae4f-19d5327a2885 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:29.505918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322117d-e6a2-4813-ae4f-19d5327a2885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:29.505918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322117d-e6a2-4813-ae4f-19d5327a2885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:29.506852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322117d-e6a2-4813-ae4f-19d5327a2885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:29.506852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322117d-e6a2-4813-ae4f-19d5327a2885 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:29.506852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 828/1642] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:30.475393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:30.476874 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:30.504057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f7ae-f26b-4d98-8d4a-76bc193009fb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:30.523604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:30.524824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:30.525335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:30.526414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] PATH_INFO: `/v3/projects/e618f8d750bd41a3a9b8b7c49e4c9d12` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:30.529441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e618f8d750bd41a3a9b8b7c49e4c9d12)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:30.532858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:30:30.532858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 20 15:30:30.532858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: Jul 20 15:30:30.536556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:30.560486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a293-d7e4-4864-9a5f-db3f8002a4ec None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:30.560968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a293-d7e4-4864-9a5f-db3f8002a4ec None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:30.561130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a293-d7e4-4864-9a5f-db3f8002a4ec None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:30.562894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 829/1643] 10.222.0.87 () {54 vars in 962 bytes} [Wed Jul 20 15:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:30:30.571838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efe66c-694a-4106-a9fc-e1e78c388caf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:30.572440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efe66c-694a-4106-a9fc-e1e78c388caf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:30.572927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efe66c-694a-4106-a9fc-e1e78c388caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:30.606859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-97efe66c-694a-4106-a9fc-e1e78c388caf None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:30.607780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97efe66c-694a-4106-a9fc-e1e78c388caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:30.743557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e618f8d750bd41a3a9b8b7c49e4c9d12', 'request_id': 'req-ea029981-edd1-4836-9b0d-a560b4eeb5ea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:30.748750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 830/1644] 10.222.0.87 () {58 vars in 1059 bytes} [Wed Jul 20 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:30.754311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5690f90-3560-4ebe-89b1-053195a0c8b4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:30.754707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5690f90-3560-4ebe-89b1-053195a0c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:30.755083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5690f90-3560-4ebe-89b1-053195a0c8b4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:30.756799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 831/1645] 10.222.0.87 () {54 vars in 912 bytes} [Wed Jul 20 15:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:30:30.758530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e618f8d750bd41a3a9b8b7c49e4c9d12', 'request_id': 'req-ea029981-edd1-4836-9b0d-a560b4eeb5ea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:30.761594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:30.761952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:30.762303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:30.800779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e618f8d750bd41a3a9b8b7c49e4c9d12', 'request_id': 'req-ea029981-edd1-4836-9b0d-a560b4eeb5ea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:30.807143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:30.809063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:30.921030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] The token cache is being invalidate because project e618f8d750bd41a3a9b8b7c49e4c9d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:30.921508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:30.922557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:30.926545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 815/1646] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:30 2022] DELETE /identity/v3/projects/e618f8d750bd41a3a9b8b7c49e4c9d12 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:30.931620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:30.934980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:30.991303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 832/1647] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:31.005329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:31.007383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:31.222566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029981-edd1-4836-9b0d-a560b4eeb5ea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:31.222566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:31.222566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:31.222566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:31.222938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] PATH_INFO: `/v3/users/1d5ca1a1d76c411bbd4f1e36cfc5c891` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:31.223007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aeef0f-86d8-44ea-9e00-55b1b31d2d49 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:31.223087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5ca1a1d76c411bbd4f1e36cfc5c891)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:31.223087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:31.223087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:31.223262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:31.223262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:31.223262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:31.223262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:31.223510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:31.223510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:31.223510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 833/1648] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:31.539463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5ca1a1d76c411bbd4f1e36cfc5c891'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.566246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5ca1a1d76c411bbd4f1e36cfc5c891'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.568041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5ca1a1d76c411bbd4f1e36cfc5c891'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.715758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5ca1a1d76c411bbd4f1e36cfc5c891'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.716425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5ca1a1d76c411bbd4f1e36cfc5c891'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:31.740386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 816/1649] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:30 2022] DELETE /identity/v3/users/1d5ca1a1d76c411bbd4f1e36cfc5c891 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:32.047736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:34.280456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.281930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:34.319616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e2cdb-6e37-4410-8be1-eea5f6b0b6ae service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.364282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:34.367070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:34.471234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80fc1b-b97e-4952-a158-e31f31861801 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:34.473823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.474769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.475071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.475336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] PATH_INFO: `/v3/users/2ba70ecaeab14d0b827defc52f87a210` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.477058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba70ecaeab14d0b827defc52f87a210)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.479069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.485147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:34.486281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.486739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.489064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] PATH_INFO: `/v3/projects/157b520344fc4bb194805618af8581d4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.491413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=157b520344fc4bb194805618af8581d4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:34.494428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:34.736329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157b520344fc4bb194805618af8581d4', 'request_id': 'req-edc914cd-7a8a-4978-89d1-00f471047d3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.756903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157b520344fc4bb194805618af8581d4', 'request_id': 'req-edc914cd-7a8a-4978-89d1-00f471047d3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.769292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157b520344fc4bb194805618af8581d4', 'request_id': 'req-edc914cd-7a8a-4978-89d1-00f471047d3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.807620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba70ecaeab14d0b827defc52f87a210'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.835122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba70ecaeab14d0b827defc52f87a210'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.886383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] The token cache is being invalidate because project 157b520344fc4bb194805618af8581d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:34.887486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.889677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-edc914cd-7a8a-4978-89d1-00f471047d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.892123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 817/1650] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:34 2022] DELETE /identity/v3/projects/157b520344fc4bb194805618af8581d4 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:34.901296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707f68f-e480-466f-b392-35a824019a52 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:34.902355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707f68f-e480-466f-b392-35a824019a52 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:34.902831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707f68f-e480-466f-b392-35a824019a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:34.929087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0707f68f-e480-466f-b392-35a824019a52 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:34.932975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0707f68f-e480-466f-b392-35a824019a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:34.943933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:34.990366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba70ecaeab14d0b827defc52f87a210'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:34.999474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba70ecaeab14d0b827defc52f87a210'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:35.000336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74cbf818-a0d2-491c-b75f-f7bf79da0155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba70ecaeab14d0b827defc52f87a210'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:35.038984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 834/1651] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:34 2022] DELETE /identity/v3/users/2ba70ecaeab14d0b827defc52f87a210 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:35.044899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.045196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.045472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.086210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:35.109049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:35.110847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:35.143453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 818/1652] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:35.147582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073173ed-9abb-4c68-ad6a-1461bbd55cc9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.147857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073173ed-9abb-4c68-ad6a-1461bbd55cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.148233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073173ed-9abb-4c68-ad6a-1461bbd55cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.203031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-073173ed-9abb-4c68-ad6a-1461bbd55cc9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:35.209293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-073173ed-9abb-4c68-ad6a-1461bbd55cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:35.260355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 835/1653] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:35.312198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:35.313694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:35.319411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 819/1654] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:35.328209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073173ed-9abb-4c68-ad6a-1461bbd55cc9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:35.354956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073173ed-9abb-4c68-ad6a-1461bbd55cc9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:35.368958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:35.369996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.370294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.370577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.371529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:35.371844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:35.377383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:35.409208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 820/1655] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:35.413541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:35.434887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406c705-d799-4b4c-ac61-af1587563655 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:35.450039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:35.451169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.451617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.451903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.452618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:35.455442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:35.457573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e15da-d841-42a1-ba8d-dfd4cf180f52 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:35.463599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:35.464500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.471146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.471146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.498086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:35.500553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:35.518251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 836/1656] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:35.605299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 821/1657] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:35 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:35.609558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:35.659719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbaba3-d9f5-4dfe-8762-0f85d7889358 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:35.820649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:35.821360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:35.829189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:35.829189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:35.829189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:35.829189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:36.018063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 837/1658] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:35 2022] POST /identity/v3/users => generated 289 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:36.022195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:36.037812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78280407-7cbc-42c0-beb7-6160b6e8a4bd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:36.052920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:36.053637 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:36.053932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:36.054524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:36.054998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:36.056652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:36.078359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 822/1659] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:36.082753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:36.098744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a0c3b-6bee-4471-b587-cd3cd1fe7043 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:36.110204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b6b3-9901-42b6-b42a-9a71a89c5f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:36.110933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b6b3-9901-42b6-b42a-9a71a89c5f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:36.111879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b6b3-9901-42b6-b42a-9a71a89c5f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:36.112240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b6b3-9901-42b6-b42a-9a71a89c5f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:36.112997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b6b3-9901-42b6-b42a-9a71a89c5f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:36.116253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9b6b3-9901-42b6-b42a-9a71a89c5f8a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:36.146318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 838/1660] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:30:36.150854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:36.170597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633ec50-099b-4693-933a-e11ff6928b5c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:36.179249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:36.180695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:36.181089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:36.181463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] PATH_INFO: `/v3/projects/bfb15196231f43d3a316cd921cd26ca7/users/009d224b4b59428abdd9da29abe86900/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:36.250898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb15196231f43d3a316cd921cd26ca7, user_id=009d224b4b59428abdd9da29abe86900, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:36.257642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:36.371830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 823/1661] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:36 2022] PUT /identity/v3/projects/bfb15196231f43d3a316cd921cd26ca7/users/009d224b4b59428abdd9da29abe86900/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:36.386120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0553e6-c3b6-4ee8-bf64-56178d43fddb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:36.386590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0553e6-c3b6-4ee8-bf64-56178d43fddb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:36.386824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0553e6-c3b6-4ee8-bf64-56178d43fddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:36.463561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0f0553e6-c3b6-4ee8-bf64-56178d43fddb None None] MFA Rules not processed for user `009d224b4b59428abdd9da29abe86900`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:36.464878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0f0553e6-c3b6-4ee8-bf64-56178d43fddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:36.619465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 839/1662] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:36.620341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:36.735110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:36.778241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:36.824487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1fa9b-93d3-421b-820b-799c7bd34aa7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:36.849284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:36.849989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:36.850282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:36.850566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:36.851347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:36.853465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:37.025223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 824/1663] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:36 2022] POST /identity/v3/projects => generated 377 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:37.026558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0553e6-c3b6-4ee8-bf64-56178d43fddb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:37.047123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0553e6-c3b6-4ee8-bf64-56178d43fddb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:37.212672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:37.213857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:37.216630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:37.217138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:37.219594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:37.227827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:37.362904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 840/1664] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:37 2022] POST /identity/v3/users => generated 295 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:37.366932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:37.381533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025514-dd3f-4f23-ab68-70bd0d3dd732 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:37.402134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:37.402917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:37.403601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:37.403889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:37.404899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:37.406524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:37.466561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 825/1665] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:37.470791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:37.487818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab59ed0-c843-494e-a37a-84e651261bf5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:37.513628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:37.515103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:37.515551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:37.515977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] PATH_INFO: `/v3/projects/839fea52cfbb449fa82efd192500c03a/users/2ca61bcc68af4833ada27b04d3eadb2f/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:37.574989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] RBAC: Authorizing `identity:create_grant(project_id=839fea52cfbb449fa82efd192500c03a, user_id=2ca61bcc68af4833ada27b04d3eadb2f, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:37.585687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:37.684752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 841/1666] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:37 2022] PUT /identity/v3/projects/839fea52cfbb449fa82efd192500c03a/users/2ca61bcc68af4833ada27b04d3eadb2f/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:37.689843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:37.729376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5157c-2b3a-4136-a73c-b1169eb90f57 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:37.971682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:37.971887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:37.973295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:37.973578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:37.974341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:37.976021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:38.027761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 826/1667] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:38.030118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:38.070694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e45af-8fa9-41a8-8d58-d428911e929f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:38.098705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a3628-dbcb-4148-baee-e01e6c735b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:38.101072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a3628-dbcb-4148-baee-e01e6c735b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:38.107800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:38.108186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a3628-dbcb-4148-baee-e01e6c735b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:38.109815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a3628-dbcb-4148-baee-e01e6c735b16 admin admin] PATH_INFO: `/v3/projects/839fea52cfbb449fa82efd192500c03a/users/2ca61bcc68af4833ada27b04d3eadb2f/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:38.110310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:38.119416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a3628-dbcb-4148-baee-e01e6c735b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839fea52cfbb449fa82efd192500c03a, user_id=2ca61bcc68af4833ada27b04d3eadb2f, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:38.122404 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a3628-dbcb-4148-baee-e01e6c735b16 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:38.133883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82170d6d-5ff5-4039-9bed-a1b3d2c46e6c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:38.146982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:38.148460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:38.148941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:38.149393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] PATH_INFO: `/v3/projects/1853181542f348a2836311e1bcabc644` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:38.151539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1853181542f348a2836311e1bcabc644)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:38.153795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:38.153911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 842/1668] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:38 2022] PUT /identity/v3/projects/839fea52cfbb449fa82efd192500c03a/users/2ca61bcc68af4833ada27b04d3eadb2f/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:38.168770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:38.171722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:38.172599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:38.242153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] MFA Rules not processed for user `2ca61bcc68af4833ada27b04d3eadb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:38.243460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:38.376238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1853181542f348a2836311e1bcabc644', 'request_id': 'req-d122e83f-4168-4e7a-b707-686b91990676'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:38.411273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1853181542f348a2836311e1bcabc644', 'request_id': 'req-d122e83f-4168-4e7a-b707-686b91990676'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:38.434784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:38.438908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1853181542f348a2836311e1bcabc644', 'request_id': 'req-d122e83f-4168-4e7a-b707-686b91990676'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:38.453081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 843/1669] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:38.464381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:38.465706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:38.548103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] The token cache is being invalidate because project 1853181542f348a2836311e1bcabc644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:38.549563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:38.550847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d122e83f-4168-4e7a-b707-686b91990676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:38.559754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 827/1670] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:38 2022] DELETE /identity/v3/projects/1853181542f348a2836311e1bcabc644 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:38.562044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0bebe-83cc-4e94-8804-c9eb5997c640 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:38.566904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0bebe-83cc-4e94-8804-c9eb5997c640 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:38.567590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0bebe-83cc-4e94-8804-c9eb5997c640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:38.616936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-82e0bebe-83cc-4e94-8804-c9eb5997c640 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:38.619372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9931e14-0a09-420f-88f2-97e1123980b7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:38.622268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82e0bebe-83cc-4e94-8804-c9eb5997c640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:38.732714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:38.764436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:38.765157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:38.765459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:38.765744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:38.781885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:38.818227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 828/1671] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:38.819866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b037f4-c652-493b-9154-5807c59d2c8c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:38.820233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b037f4-c652-493b-9154-5807c59d2c8c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:38.823052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b037f4-c652-493b-9154-5807c59d2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:38.864851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c6b037f4-c652-493b-9154-5807c59d2c8c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:38.868614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c6b037f4-c652-493b-9154-5807c59d2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:38.892128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 829/1672] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:38.896588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b037f4-c652-493b-9154-5807c59d2c8c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:38.919526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b037f4-c652-493b-9154-5807c59d2c8c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:38.933602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:38.934378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:38.942093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:38.942093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:38.942093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:38.942093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:38.942093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:38.981949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 830/1673] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:30:38.982140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:38.983551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:38.990784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:38.997499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5e635-2dfb-4b50-a9d4-023372420500 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:39.005917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 844/1674] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:39.016808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:39.019521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:39.021100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:39.021100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:39.022886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:39.027487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:39.174826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 831/1675] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:38 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:39.175299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:39.203675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1961747-0265-4d01-a43a-00ef0ca78fac service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:39.364051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:39.371741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:39.372383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:39.373146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:39.374105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:39.376407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:39.389604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:39.466273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 845/1676] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:39 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:39.468063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:39.488748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a50ae-ce5c-4ea8-94f8-cdf2316102d6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:39.512985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:39.515397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:39.515397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:39.518027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:39.519411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:39.521252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:39.557031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 832/1677] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:39.561298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:39.574011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1682a-cbf7-4b96-8e03-be94712c1b5b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:39.581357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dc06-1746-4c8d-95fa-f9d57122bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:39.582065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dc06-1746-4c8d-95fa-f9d57122bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:39.582914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dc06-1746-4c8d-95fa-f9d57122bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:39.583856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dc06-1746-4c8d-95fa-f9d57122bd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:39.585586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dc06-1746-4c8d-95fa-f9d57122bd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:39.587855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dc06-1746-4c8d-95fa-f9d57122bd06 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:39.620353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 846/1678] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:39.624908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:39.640304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e0bc-ef5f-4621-9b1d-296a0d94d06b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:39.652951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:39.656468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:39.659395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:39.659952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] PATH_INFO: `/v3/projects/5707eb920904489cb293fcff80098ff1/users/0b942cb55a6745b69d3aa0c2655eb413/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:39.728167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5707eb920904489cb293fcff80098ff1, user_id=0b942cb55a6745b69d3aa0c2655eb413, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:39.731155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:39.854737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 833/1679] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:39 2022] PUT /identity/v3/projects/5707eb920904489cb293fcff80098ff1/users/0b942cb55a6745b69d3aa0c2655eb413/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:30:39.857148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797413b8-09f7-453d-9bfc-1feb257a9234 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:39.857503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797413b8-09f7-453d-9bfc-1feb257a9234 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:39.857865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797413b8-09f7-453d-9bfc-1feb257a9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:39.941881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-797413b8-09f7-453d-9bfc-1feb257a9234 None None] MFA Rules not processed for user `0b942cb55a6745b69d3aa0c2655eb413`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:39.952482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-797413b8-09f7-453d-9bfc-1feb257a9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:40.235262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:40.240296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 847/1680] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:40.397884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f314a-ac67-4091-8105-0e2647d0e475 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:40.404611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:40.405306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:40.405596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:40.405880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:40.406586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:40.409197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:40.538058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 834/1681] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:40 2022] POST /identity/v3/projects => generated 377 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:40.554678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797413b8-09f7-453d-9bfc-1feb257a9234 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:40.588168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797413b8-09f7-453d-9bfc-1feb257a9234 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:40.787645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:40.788941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:40.789282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:40.789682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:40.790708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:40.796300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:40.930848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 848/1682] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:40 2022] POST /identity/v3/users => generated 289 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:40.935855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:40.962149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276f21-978a-4f9c-97b6-3b5e3f183e79 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:40.976770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:40.980857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:40.981724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:40.982634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:40.984408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:40.989464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:41.030485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 835/1683] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:41.031349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:41.049225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f9c40-30d5-4636-b5f6-44e37473c75f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:41.060557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5a69e-d282-4f6d-ba57-f25525ce315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:41.060781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a69e-d282-4f6d-ba57-f25525ce315a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:41.061592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a69e-d282-4f6d-ba57-f25525ce315a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:41.061887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a69e-d282-4f6d-ba57-f25525ce315a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:41.062867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5a69e-d282-4f6d-ba57-f25525ce315a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:41.066251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5a69e-d282-4f6d-ba57-f25525ce315a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:41.118000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 849/1684] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:41.123577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:41.145792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712968c2-e624-49a0-be60-4eba01d78972 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:41.160355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbded8-730e-43c2-bcf3-4cd4488d3403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:41.162400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbded8-730e-43c2-bcf3-4cd4488d3403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:41.164292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbded8-730e-43c2-bcf3-4cd4488d3403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:41.165753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbded8-730e-43c2-bcf3-4cd4488d3403 admin admin] PATH_INFO: `/v3/projects/9880e611cbd04ed1911f5b294e7d3d13/users/b932dbb8818a452ea192d6a4a7dd8590/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:41.222207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbded8-730e-43c2-bcf3-4cd4488d3403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9880e611cbd04ed1911f5b294e7d3d13, user_id=b932dbb8818a452ea192d6a4a7dd8590, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:41.237386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbded8-730e-43c2-bcf3-4cd4488d3403 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:41.360110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:41.360445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:41.360739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:41.413153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] MFA Rules not processed for user `f004a4778f7d46119108b09bdccb8739`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:41.414340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:41.436210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 836/1685] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:41 2022] PUT /identity/v3/projects/9880e611cbd04ed1911f5b294e7d3d13/users/b932dbb8818a452ea192d6a4a7dd8590/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:41.441518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cde25-42e2-442a-b146-2a8e94bc16f3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:41.442095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cde25-42e2-442a-b146-2a8e94bc16f3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:41.444575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cde25-42e2-442a-b146-2a8e94bc16f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:41.505020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:41.536621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c35cde25-42e2-442a-b146-2a8e94bc16f3 None None] MFA Rules not processed for user `b932dbb8818a452ea192d6a4a7dd8590`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:41.538234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c35cde25-42e2-442a-b146-2a8e94bc16f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:41.546400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:41.604485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 850/1686] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:41.624560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:41.627045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:41.768054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 837/1687] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:41.782201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cde25-42e2-442a-b146-2a8e94bc16f3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:41.813725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef9c4e-a049-4b4c-bb25-78b199cf150e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:41.830151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f764b-22cd-4ea5-a52a-803403740547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:41.831274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f764b-22cd-4ea5-a52a-803403740547 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:41.831592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f764b-22cd-4ea5-a52a-803403740547 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:41.831893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f764b-22cd-4ea5-a52a-803403740547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:41.852751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f764b-22cd-4ea5-a52a-803403740547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:41.854407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f764b-22cd-4ea5-a52a-803403740547 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:41.882252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 851/1688] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:41.953693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:41.954016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:41.954289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:42.044419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cde25-42e2-442a-b146-2a8e94bc16f3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:42.051362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:42.052670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:42.052670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:42.052800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:42.054176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:42.058918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:42.068827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] MFA Rules not processed for user `760a7a314a9c4a788e751ce19c13ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:42.068827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:42.162324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 838/1689] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:41 2022] POST /identity/v3/projects => generated 375 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:42.164028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:42.274748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 852/1690] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:42.290279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:42.292932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:42.303437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b18216-7eb9-48b4-8e8f-846393afafab admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:42.310547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:42.311524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:42.311985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:42.312463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:42.343233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17cf2a-4b43-4963-8a0e-e67727dfc909 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:42.353759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:42.362179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:42.526547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 839/1691] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:42 2022] POST /identity/v3/users => generated 294 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:30:42.531771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:42.551325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:42.554214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:42.554214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:42.555617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:42.560882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f784d-822b-4cfd-8ae9-5102c85e4a00 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:42.585738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:42.589015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:42.589310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:42.589602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:42.590357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:42.596385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:42.631861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 840/1692] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:42.635230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:42.652717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:42.670551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd8ec7-e2ea-4eee-9c90-39d081e781a9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:42.675220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:42.687983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:42.688934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:42.689901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:42.690345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] PATH_INFO: `/v3/projects/713ffe1e1f1c4987b299c3e8e13dfc8c/users/d6fd662ba45f45cf89da42734039db1b/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:42.731912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:42.733923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:42.759037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 853/1693] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:42.801327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713ffe1e1f1c4987b299c3e8e13dfc8c, user_id=d6fd662ba45f45cf89da42734039db1b, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:42.804412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:42.918624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 841/1694] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:42 2022] PUT /identity/v3/projects/713ffe1e1f1c4987b299c3e8e13dfc8c/users/d6fd662ba45f45cf89da42734039db1b/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:42.922721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:42.935800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9692a-de0b-4cbb-8665-5cc719fe2b62 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:43.169369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee665843-7fcf-42e9-973b-e6c9a57a5e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:43.170086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665843-7fcf-42e9-973b-e6c9a57a5e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:43.170382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665843-7fcf-42e9-973b-e6c9a57a5e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:43.170789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665843-7fcf-42e9-973b-e6c9a57a5e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:43.171643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee665843-7fcf-42e9-973b-e6c9a57a5e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:43.173345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee665843-7fcf-42e9-973b-e6c9a57a5e08 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:43.212452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 854/1695] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:30:43.216705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:43.238569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce96fc-4bfd-4fbf-ba53-a549c99cfe13 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:43.259298 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:43.260236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:43.260557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:43.260841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] PATH_INFO: `/v3/projects/713ffe1e1f1c4987b299c3e8e13dfc8c/users/d6fd662ba45f45cf89da42734039db1b/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:43.264861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713ffe1e1f1c4987b299c3e8e13dfc8c, user_id=d6fd662ba45f45cf89da42734039db1b, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:43.272693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:43.311639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 842/1696] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:43 2022] PUT /identity/v3/projects/713ffe1e1f1c4987b299c3e8e13dfc8c/users/d6fd662ba45f45cf89da42734039db1b/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:43.316646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:43.316944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:43.317226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:43.382209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] MFA Rules not processed for user `d6fd662ba45f45cf89da42734039db1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:43.383495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:43.525394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:43.527339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:43.637999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 855/1697] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:43.645228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:43.647158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:43.702014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:43.704056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ed869-3a00-444f-8229-a1631446ca08 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:43.716075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:43.718056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:43.721718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:43.722354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] PATH_INFO: `/v3/users/0745a6ca3e464ac9ac58ca1e21f3a7cf` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:43.724023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0745a6ca3e464ac9ac58ca1e21f3a7cf)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:43.728093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:43.807302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e65f8b-69ba-4e03-8395-39cbd570e487 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:43.821731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f49c7-08c1-4215-bdaa-607a60ea5eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:43.822435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f49c7-08c1-4215-bdaa-607a60ea5eef service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:43.822751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f49c7-08c1-4215-bdaa-607a60ea5eef service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:43.823039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f49c7-08c1-4215-bdaa-607a60ea5eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:43.954097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f49c7-08c1-4215-bdaa-607a60ea5eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:43.957054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f49c7-08c1-4215-bdaa-607a60ea5eef service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:43.986085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 856/1698] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:44.011391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0745a6ca3e464ac9ac58ca1e21f3a7cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:44.047720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0745a6ca3e464ac9ac58ca1e21f3a7cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:44.048354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0745a6ca3e464ac9ac58ca1e21f3a7cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:44.184429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0745a6ca3e464ac9ac58ca1e21f3a7cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:44.185121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0745a6ca3e464ac9ac58ca1e21f3a7cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:44.221884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 843/1699] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:43 2022] DELETE /identity/v3/users/0745a6ca3e464ac9ac58ca1e21f3a7cf => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:44.227596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:44.237537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:44.237537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:44.250816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:44.253636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:44.277321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:44.297379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:44.390802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:44.430852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36a429-dfbe-4302-8a90-8d2a9517a500 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:44.445848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823da115-1218-4149-ba7f-73abe4f83233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:44.446871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823da115-1218-4149-ba7f-73abe4f83233 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:44.447159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823da115-1218-4149-ba7f-73abe4f83233 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:44.447454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823da115-1218-4149-ba7f-73abe4f83233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:44.450332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-823da115-1218-4149-ba7f-73abe4f83233 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:44.484285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 857/1700] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:44.496810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:44.499914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:44.650029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823da115-1218-4149-ba7f-73abe4f83233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:44.652541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823da115-1218-4149-ba7f-73abe4f83233 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:44.672303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 844/1701] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:44.723749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e720f8-f1c5-449b-b22f-88cc02f6a158 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:44.737390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec8f7e-13ad-476f-9a2e-efaf1ce2ade0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:44.746343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8f7e-13ad-476f-9a2e-efaf1ce2ade0 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:44.746723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8f7e-13ad-476f-9a2e-efaf1ce2ade0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:44.747022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8f7e-13ad-476f-9a2e-efaf1ce2ade0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:44.789561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec8f7e-13ad-476f-9a2e-efaf1ce2ade0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:44.791586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec8f7e-13ad-476f-9a2e-efaf1ce2ade0 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:44.817353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 858/1702] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:45.921144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:45.926153 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:45.926153 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:46.000970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] MFA Rules not processed for user `a71a9f43fc024c188e6b5285b9d81c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:46.018684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:46.201535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225582fb-5634-4624-8a3c-e4f310c81ba4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:46.201535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225582fb-5634-4624-8a3c-e4f310c81ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:46.201535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225582fb-5634-4624-8a3c-e4f310c81ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:46.256344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:46.265533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 845/1703] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:46.280795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:46.282463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:46.283743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-225582fb-5634-4624-8a3c-e4f310c81ba4 None None] MFA Rules not processed for user `cc17873bfe0542feae57ffe881cc1598`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:46.291236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-225582fb-5634-4624-8a3c-e4f310c81ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:46.490020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 859/1704] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:30:46.492438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:46.492978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:46.493483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:46.501544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406487d-f413-4adb-80a7-ca14c7170d49 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:46.525333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:46.527168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:46.527345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:46.527629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:46.548279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] MFA Rules not processed for user `cc17873bfe0542feae57ffe881cc1598`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:46.549674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:46.554090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:46.555499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:46.579281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 860/1705] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:46.588474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 846/1706] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:46.602252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:46.603754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:46.640720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692d439-f24a-4d7e-b2ee-14893cfd3168 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:46.661948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:46.663108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:46.663678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:46.671456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:46.697456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:46.703558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:46.782604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 861/1707] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:47.393292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:47.397840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:47.427210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789a546-a457-4818-a98a-c44ebede22e3 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:47.450512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:47.454176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:47.457166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:47.462952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] PATH_INFO: `/v3/projects/d0aada6b8c2b45e49ceb2bb8a039d828` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:47.479257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0aada6b8c2b45e49ceb2bb8a039d828)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:47.491741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:47.521247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:47.764454 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:47.777678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e7afe-7d19-4281-868d-cda312018b4f service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:47.816872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0aada6b8c2b45e49ceb2bb8a039d828', 'request_id': 'req-2ec51385-e1a5-429a-ac26-7ad483db0f40'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.852411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0aada6b8c2b45e49ceb2bb8a039d828', 'request_id': 'req-2ec51385-e1a5-429a-ac26-7ad483db0f40'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.877314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0aada6b8c2b45e49ceb2bb8a039d828', 'request_id': 'req-2ec51385-e1a5-429a-ac26-7ad483db0f40'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:47.969426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a23665-aa88-410a-874a-42d68863e599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:47.970112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23665-aa88-410a-874a-42d68863e599 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:47.971023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23665-aa88-410a-874a-42d68863e599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:47.971311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a23665-aa88-410a-874a-42d68863e599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:47.976082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-65a23665-aa88-410a-874a-42d68863e599 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:48.025262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] The token cache is being invalidate because project d0aada6b8c2b45e49ceb2bb8a039d828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:48.031264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:48.031264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:48.031264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 847/1708] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:47 2022] DELETE /identity/v3/projects/d0aada6b8c2b45e49ceb2bb8a039d828 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:48.039134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:48.042666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:48.202508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a23665-aa88-410a-874a-42d68863e599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:48.208806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a23665-aa88-410a-874a-42d68863e599 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:48.235303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 862/1709] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:48.238892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0faa8-fc25-4dbd-ae81-2c9ede6a5aea None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:48.240714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0faa8-fc25-4dbd-ae81-2c9ede6a5aea None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:48.241543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0faa8-fc25-4dbd-ae81-2c9ede6a5aea None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:48.261408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 863/1710] 10.222.0.87 () {54 vars in 912 bytes} [Wed Jul 20 15:30:48 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:30:48.265659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec51385-e1a5-429a-ac26-7ad483db0f40 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:48.271163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:48.271700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:48.272569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:48.334293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:48.336028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:48.336598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:48.341564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] PATH_INFO: `/v3/users/8ea95968cf10467b8adaf2c40b8d4759` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:48.350320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea95968cf10467b8adaf2c40b8d4759)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:48.352825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:48.531054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] MFA Rules not processed for user `a1c06e34aaac441e8b1a6366cc384524`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:48.532701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:48.633240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:48.711612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea95968cf10467b8adaf2c40b8d4759'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:48.759296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea95968cf10467b8adaf2c40b8d4759'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:48.760578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea95968cf10467b8adaf2c40b8d4759'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:48.776362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 864/1711] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:48.810879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:48.817318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:48.833503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba512f-0f65-491b-847d-956baf28b18a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:48.841400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea95968cf10467b8adaf2c40b8d4759'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:48.843401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8484b8fb-cba0-4da0-9815-4ba8c970b73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea95968cf10467b8adaf2c40b8d4759'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:48.844908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb93e22-0b43-487e-87f5-48c556fbd5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:48.847657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93e22-0b43-487e-87f5-48c556fbd5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:48.847957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93e22-0b43-487e-87f5-48c556fbd5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:48.848241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93e22-0b43-487e-87f5-48c556fbd5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:48.866560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb93e22-0b43-487e-87f5-48c556fbd5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:48.868427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb93e22-0b43-487e-87f5-48c556fbd5b1 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:48.881756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 865/1712] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:48.887112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 848/1713] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:48 2022] DELETE /identity/v3/users/8ea95968cf10467b8adaf2c40b8d4759 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:49.712494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560f34-e181-4128-a430-7108d561b386 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:49.715252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560f34-e181-4128-a430-7108d561b386 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:49.717435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560f34-e181-4128-a430-7108d561b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:49.781083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-22560f34-e181-4128-a430-7108d561b386 None None] MFA Rules not processed for user `f004a4778f7d46119108b09bdccb8739`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:49.782400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-22560f34-e181-4128-a430-7108d561b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:49.947137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 866/1714] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:50.432813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:50.433812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:50.434246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:50.480699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:50.510377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] MFA Rules not processed for user `96fa33ffb9e74daa8e5a4223176ba94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:50.521889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:50.865918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 849/1715] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:50.875091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:50.875656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:50.875656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:50.943940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] MFA Rules not processed for user `96fa33ffb9e74daa8e5a4223176ba94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:50.945357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:50.948846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:50.950804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:50.982233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 867/1716] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:51.070807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff39e7-0743-4ba5-a909-27fc4d04fa3d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:51.082174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1422-6a14-488d-9630-1ad2559f8a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:51.087811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1422-6a14-488d-9630-1ad2559f8a7d service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.087811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1422-6a14-488d-9630-1ad2559f8a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.087811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1422-6a14-488d-9630-1ad2559f8a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.087811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f21a1422-6a14-488d-9630-1ad2559f8a7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:51.187576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1422-6a14-488d-9630-1ad2559f8a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:51.189678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1422-6a14-488d-9630-1ad2559f8a7d service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:51.204594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 850/1717] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:30:51.278374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:51.280228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:51.436433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1438-a652-4d5c-8504-c5a4ca69e707 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.437013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1438-a652-4d5c-8504-c5a4ca69e707 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.437468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1438-a652-4d5c-8504-c5a4ca69e707 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.439662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 851/1718] 10.222.0.87 () {54 vars in 961 bytes} [Wed Jul 20 15:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:30:51.449608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2594f-6cc9-4ca1-830e-c267468cc4fe None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.451042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2594f-6cc9-4ca1-830e-c267468cc4fe None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.451567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2594f-6cc9-4ca1-830e-c267468cc4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.508510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f2b2594f-6cc9-4ca1-830e-c267468cc4fe None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:51.509964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f2b2594f-6cc9-4ca1-830e-c267468cc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:51.636577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697d6d-e27b-4e81-b944-52bf44b60804 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:51.660315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a9ef5-379a-49b8-ab00-c2bdde6b2960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:51.661000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a9ef5-379a-49b8-ab00-c2bdde6b2960 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.661286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a9ef5-379a-49b8-ab00-c2bdde6b2960 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.661567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a9ef5-379a-49b8-ab00-c2bdde6b2960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.696122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a9ef5-379a-49b8-ab00-c2bdde6b2960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:51.703949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a9ef5-379a-49b8-ab00-c2bdde6b2960 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:51.729687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 852/1719] 10.222.0.87 () {58 vars in 1058 bytes} [Wed Jul 20 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 20 15:30:51.733389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7882ce7-5220-4f7d-9e0e-5f5e6e15e1a7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.733761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7882ce7-5220-4f7d-9e0e-5f5e6e15e1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.734120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7882ce7-5220-4f7d-9e0e-5f5e6e15e1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.743839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 868/1720] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:51.749891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944bd74-5808-498b-830b-a61fd7272bfc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.750669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944bd74-5808-498b-830b-a61fd7272bfc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.751149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944bd74-5808-498b-830b-a61fd7272bfc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.755656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 869/1721] 10.222.0.87 () {54 vars in 912 bytes} [Wed Jul 20 15:30:51 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:30:51.761797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944bd74-5808-498b-830b-a61fd7272bfc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:51.763601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a7882ce7-5220-4f7d-9e0e-5f5e6e15e1a7 None None] MFA Rules not processed for user `760a7a314a9c4a788e751ce19c13ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:51.765286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a7882ce7-5220-4f7d-9e0e-5f5e6e15e1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:51.826307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944bd74-5808-498b-830b-a61fd7272bfc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:51.846954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:51.847988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.848523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.849367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.858724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:51.872635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 853/1722] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:51.872635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:51.872635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:51.880486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:51.902205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:51.906675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:51.919544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] MFA Rules not processed for user `a1c06e34aaac441e8b1a6366cc384524`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:51.941256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:51.953943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 870/1723] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:51.960419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:51.965246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:52.124875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:52.170378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 854/1724] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:52.184346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:52.186680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:52.208754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a55e12-d0f6-4d7c-bf65-0d1789799165 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:52.217702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3954-5857-43ff-a0ea-06bb5b1984f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:52.220001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3954-5857-43ff-a0ea-06bb5b1984f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:52.220878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3954-5857-43ff-a0ea-06bb5b1984f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:52.224245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3954-5857-43ff-a0ea-06bb5b1984f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:52.250913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3954-5857-43ff-a0ea-06bb5b1984f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:52.250913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3954-5857-43ff-a0ea-06bb5b1984f0 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:52.259312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bddf2d-3bd2-42cd-9594-44688b14484a service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:52.271167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 855/1725] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:52.294072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:52.297920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:52.299294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:52.300551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] PATH_INFO: `/v3/projects/8fd1d5a5692040aebb14a273ba20938b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:52.314967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd1d5a5692040aebb14a273ba20938b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:52.320624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:52.603623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd1d5a5692040aebb14a273ba20938b', 'request_id': 'req-4b49f63a-1313-41b1-b584-344a86678ca2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:52.701219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:52.725372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd1d5a5692040aebb14a273ba20938b', 'request_id': 'req-4b49f63a-1313-41b1-b584-344a86678ca2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:52.749171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd1d5a5692040aebb14a273ba20938b', 'request_id': 'req-4b49f63a-1313-41b1-b584-344a86678ca2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:52.796309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] The token cache is being invalidate because project 8fd1d5a5692040aebb14a273ba20938b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:30:52.796309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:52.796584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f63a-1313-41b1-b584-344a86678ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:52.798825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 871/1726] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:30:51 2022] DELETE /identity/v3/projects/8fd1d5a5692040aebb14a273ba20938b => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:52.806356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ea7-77e8-46fd-99fb-e913517c8c71 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:52.806546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ea7-77e8-46fd-99fb-e913517c8c71 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:52.811444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ea7-77e8-46fd-99fb-e913517c8c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:52.909569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a8d85ea7-77e8-46fd-99fb-e913517c8c71 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:52.910758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a8d85ea7-77e8-46fd-99fb-e913517c8c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:53.085548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 856/1727] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:53.087529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab2f27-7d48-4fa8-b9f6-b7eea529a83d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:53.088736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab2f27-7d48-4fa8-b9f6-b7eea529a83d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:53.089176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab2f27-7d48-4fa8-b9f6-b7eea529a83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:53.145265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d4ab2f27-7d48-4fa8-b9f6-b7eea529a83d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:53.146686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d4ab2f27-7d48-4fa8-b9f6-b7eea529a83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:53.167561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 872/1728] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:53.172144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85ea7-77e8-46fd-99fb-e913517c8c71 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:53.200070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d85ea7-77e8-46fd-99fb-e913517c8c71 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:53.227580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:53.232515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:53.236640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:53.240171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:53.240171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:30:53.246546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:53.252958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:53.288303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 857/1729] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:30:53.295052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab2f27-7d48-4fa8-b9f6-b7eea529a83d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:53.321992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab2f27-7d48-4fa8-b9f6-b7eea529a83d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:53.334929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:53.335869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:53.336320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:53.336909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:53.337780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:53.363087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:53.529554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 873/1730] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:53 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:53.538763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:53.570942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba07c4-389e-442f-96f0-d68f0ee528d3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:53.610581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:53.715171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:53.718631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:53.719204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:53.720244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:53.722374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:53.724732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:53.870945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 858/1731] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:53 2022] POST /identity/v3/users => generated 288 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:53.876402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:53.917008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e2407-72f8-47cc-8bbb-b88b8a8bbb98 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:53.953501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:53.956106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:53.956838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:53.963485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:53.964322 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:53.981376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:54.078246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:54.079197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 874/1732] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:54.091797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6b4c-6660-441b-9d6d-5c029610b973 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:54.114350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1759-67b7-4abf-80d0-ca050efec563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:54.115112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1759-67b7-4abf-80d0-ca050efec563 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:54.115404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1759-67b7-4abf-80d0-ca050efec563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:54.119874 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1759-67b7-4abf-80d0-ca050efec563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:54.119874 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a1759-67b7-4abf-80d0-ca050efec563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:54.119874 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a1759-67b7-4abf-80d0-ca050efec563 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:54.148911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 859/1733] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:30:54.157605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:54.183198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dbd45-0088-4682-b8ba-aa0672f093d9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:54.203359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:54.204300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:54.205310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:54.205738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] PATH_INFO: `/v3/projects/390677b3ddf34610a8cc285e2e793d01/users/84a5d391e20b465abbed3b114db4fd72/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:54.274366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390677b3ddf34610a8cc285e2e793d01, user_id=84a5d391e20b465abbed3b114db4fd72, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:54.280964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:54.397380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 875/1734] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:54 2022] PUT /identity/v3/projects/390677b3ddf34610a8cc285e2e793d01/users/84a5d391e20b465abbed3b114db4fd72/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:54.411750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6972d7-98d5-4bdf-b39f-a424844f4088 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:54.412157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6972d7-98d5-4bdf-b39f-a424844f4088 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:54.412516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6972d7-98d5-4bdf-b39f-a424844f4088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:54.490737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5e6972d7-98d5-4bdf-b39f-a424844f4088 None None] MFA Rules not processed for user `84a5d391e20b465abbed3b114db4fd72`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:54.492188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5e6972d7-98d5-4bdf-b39f-a424844f4088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:54.708041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 860/1735] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:54.709253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:54.929140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:54.944948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b871a-ea5e-4b89-a605-f50bc5ffd351 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:54.975653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b96654-a821-4040-bf61-56a388d5152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:54.976658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b96654-a821-4040-bf61-56a388d5152f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:54.978582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b96654-a821-4040-bf61-56a388d5152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:54.979070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b96654-a821-4040-bf61-56a388d5152f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:54.979978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b96654-a821-4040-bf61-56a388d5152f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:54.984900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b96654-a821-4040-bf61-56a388d5152f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:55.143379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 876/1736] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:30:54 2022] POST /identity/v3/projects => generated 379 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:55.147136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6972d7-98d5-4bdf-b39f-a424844f4088 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:55.173989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6972d7-98d5-4bdf-b39f-a424844f4088 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:55.410834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677beb77-0766-4c2c-90f7-ff30e7604f77 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:55.411762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677beb77-0766-4c2c-90f7-ff30e7604f77 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:55.412406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677beb77-0766-4c2c-90f7-ff30e7604f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:55.455332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:55.457761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:55.458053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:55.458340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:55.459133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:55.463994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-677beb77-0766-4c2c-90f7-ff30e7604f77 None None] MFA Rules not processed for user `96fa33ffb9e74daa8e5a4223176ba94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:55.465312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-677beb77-0766-4c2c-90f7-ff30e7604f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:55.478184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:55.671402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 861/1737] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:30:55 2022] POST /identity/v3/users => generated 296 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:30:55.677801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:55.712511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065be0b3-20da-460f-9d41-c5f4c478a735 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:55.729892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 877/1738] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:55.767205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:55.771494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:55.776796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:55.777085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:55.777868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:55.779970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:55.808382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b49be-4e4c-4a12-b797-865b6e995e80 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:55.808696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b49be-4e4c-4a12-b797-865b6e995e80 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:55.808982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b49be-4e4c-4a12-b797-865b6e995e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:55.856837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 862/1739] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:55.864530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:55.880574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:55.880933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5e4b49be-4e4c-4a12-b797-865b6e995e80 None None] MFA Rules not processed for user `a71a9f43fc024c188e6b5285b9d81c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:55.882872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5e4b49be-4e4c-4a12-b797-865b6e995e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:55.912850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03e888-6640-4158-826b-5038cf7aa93a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:55.944346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:55.944346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:55.944346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:55.947950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] PATH_INFO: `/v3/projects/f7ddd7f1d850427e92a4debaf0aed174/users/323c6028a0fb47959add1da0edf84c68/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:56.014080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ddd7f1d850427e92a4debaf0aed174, user_id=323c6028a0fb47959add1da0edf84c68, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:56.024106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:56.152207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 863/1740] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:55 2022] PUT /identity/v3/projects/f7ddd7f1d850427e92a4debaf0aed174/users/323c6028a0fb47959add1da0edf84c68/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:56.165120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:56.272786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 878/1741] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:56.436549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a7c5-66d2-4143-87bd-ebd4fd1aaa47 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:56.477980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2231bc-d082-4cbc-9995-a327663ca5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:56.479813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2231bc-d082-4cbc-9995-a327663ca5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:56.481434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2231bc-d082-4cbc-9995-a327663ca5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:56.503804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2231bc-d082-4cbc-9995-a327663ca5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:56.516613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2231bc-d082-4cbc-9995-a327663ca5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:56.528789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2231bc-d082-4cbc-9995-a327663ca5ca admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:56.585948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 864/1742] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:30:56.590155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b49be-4e4c-4a12-b797-865b6e995e80 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:56.625586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b49be-4e4c-4a12-b797-865b6e995e80 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:56.645088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:56.646021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:56.647376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:56.647586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] PATH_INFO: `/v3/projects/f7ddd7f1d850427e92a4debaf0aed174/users/323c6028a0fb47959add1da0edf84c68/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:56.653460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ddd7f1d850427e92a4debaf0aed174, user_id=323c6028a0fb47959add1da0edf84c68, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:56.657094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:56.772829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 879/1743] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:30:56 2022] PUT /identity/v3/projects/f7ddd7f1d850427e92a4debaf0aed174/users/323c6028a0fb47959add1da0edf84c68/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:56.784042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:56.789788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:56.789788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:56.901778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] MFA Rules not processed for user `323c6028a0fb47959add1da0edf84c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:56.905897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:57.036606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 865/1744] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:30:57.056601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:57.056601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:57.258835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a79fe-0aab-4425-910f-22ce742aa4fc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:57.275134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5653eed-8496-4a89-bf83-b9039879b340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:57.280450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5653eed-8496-4a89-bf83-b9039879b340 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:57.281154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5653eed-8496-4a89-bf83-b9039879b340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:57.283132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5653eed-8496-4a89-bf83-b9039879b340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:57.428650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5653eed-8496-4a89-bf83-b9039879b340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:57.431478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5653eed-8496-4a89-bf83-b9039879b340 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:57.463255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 880/1745] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:30:57.925121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:58.904628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:30:58.908574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:59.144838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc00988-2c21-465d-819e-053a35ac4388 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:30:59.172684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:30:59.176088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:59.176747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:59.177250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] PATH_INFO: `/v3/users/0b942cb55a6745b69d3aa0c2655eb413` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:59.181656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b942cb55a6745b69d3aa0c2655eb413)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:30:59.187872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:30:59.193799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:30:59.419246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:59.420765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:59.421529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:59.527820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b942cb55a6745b69d3aa0c2655eb413'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.546437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b942cb55a6745b69d3aa0c2655eb413'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.547422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b942cb55a6745b69d3aa0c2655eb413'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.658487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b942cb55a6745b69d3aa0c2655eb413'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.659211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d96aad1c-1f9d-4cfa-9c40-fc0cf4ecb5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b942cb55a6745b69d3aa0c2655eb413'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:30:59.684233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:59.689813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:30:59.716806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 866/1746] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:30:58 2022] DELETE /identity/v3/users/0b942cb55a6745b69d3aa0c2655eb413 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:30:59.729068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:30:59.732956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:30:59.735233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:30:59.815699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:30:59.820852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:00.056890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 867/1747] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:00.063040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 881/1748] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 646 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:00.074702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:00.074851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:00.285872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf479d-28f5-4b08-9519-891083ab3b69 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:00.304938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:00.306086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:00.308708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:00.312419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:00.383603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:00.390762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:00.478282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 868/1749] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:00.671463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:00.679937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:01.169468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:01.172261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:01.259852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:01.422032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74784949-ecff-469d-8d23-d2445cebd8c8 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:01.431707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:01.436953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:01.437804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:01.438290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:01.443087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:01.508701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f47de4-4e27-4284-8fb1-7ce8c6b622dc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:01.693280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:01.759533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:01.764500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:01.815449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 869/1750] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:01.874594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a194c1-726d-4a5c-b575-d258a2a6f830 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:01.876535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a194c1-726d-4a5c-b575-d258a2a6f830 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:01.876535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a194c1-726d-4a5c-b575-d258a2a6f830 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:01.876535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a194c1-726d-4a5c-b575-d258a2a6f830 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:02.141596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a194c1-726d-4a5c-b575-d258a2a6f830 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:02.150327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a194c1-726d-4a5c-b575-d258a2a6f830 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:02.181650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 882/1751] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:31:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1511 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:31:05.233858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.235610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:05.279600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565f4a-d28e-44dd-8643-bab39a5a21f2 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.291051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.291951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.292234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.292504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] PATH_INFO: `/v3/projects/5707eb920904489cb293fcff80098ff1` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.299258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5707eb920904489cb293fcff80098ff1)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.301251 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.566271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5707eb920904489cb293fcff80098ff1', 'request_id': 'req-1a278a42-eb23-4749-ab97-18d6cc48c7dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:05.574963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5707eb920904489cb293fcff80098ff1', 'request_id': 'req-1a278a42-eb23-4749-ab97-18d6cc48c7dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:05.587453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5707eb920904489cb293fcff80098ff1', 'request_id': 'req-1a278a42-eb23-4749-ab97-18d6cc48c7dc'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:05.612698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.613284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.613284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.660119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] MFA Rules not processed for user `a1c06e34aaac441e8b1a6366cc384524`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:05.662028 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:05.753935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] The token cache is being invalidate because project 5707eb920904489cb293fcff80098ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:05.753935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:05.753935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:05.755545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 870/1752] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:05 2022] DELETE /identity/v3/projects/5707eb920904489cb293fcff80098ff1 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:05.762149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.763814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:05.858718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 883/1753] 10.222.0.86 () {58 vars in 1015 bytes} [Wed Jul 20 15:31:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:05.904192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:05.910904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:05.945601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9b3ea-123d-415a-bf0c-8fc84640aa5b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.951983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:05.962408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278a42-eb23-4749-ab97-18d6cc48c7dc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:05.966964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.968614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.969133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.969624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.977330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:05.983674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:05.983674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:05.983674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] PATH_INFO: `/v3/users/b932dbb8818a452ea192d6a4a7dd8590` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:05.983674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b932dbb8818a452ea192d6a4a7dd8590)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.987684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:05.988322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:05.999277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.020526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 884/1754] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:06.052700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:06.055981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:06.069617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef9ac5-203e-437b-a85e-bb7fa9348ab0 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:06.074036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:06.075334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:06.075851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:06.076288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:06.098289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:06.098694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:06.113952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 885/1755] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:06.295420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b932dbb8818a452ea192d6a4a7dd8590'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:06.340802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b932dbb8818a452ea192d6a4a7dd8590'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:06.341714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b932dbb8818a452ea192d6a4a7dd8590'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:06.435845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b932dbb8818a452ea192d6a4a7dd8590'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:06.437415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b932dbb8818a452ea192d6a4a7dd8590'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:06.480565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 871/1756] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:05 2022] DELETE /identity/v3/users/b932dbb8818a452ea192d6a4a7dd8590 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:08.375745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:08.379074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:08.409177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629320af-dd8c-4cc9-8b6d-af2e139a1e61 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:08.571748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:08.601252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:08.602913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:08.609863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:08.617800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:08.622960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:08.623433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] PATH_INFO: `/v3/users/009d224b4b59428abdd9da29abe86900` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:08.632836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=009d224b4b59428abdd9da29abe86900)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:08.637763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:08.640973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf131c97-3061-48e0-ae42-a12dc484b3a5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:08.667311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:08.668228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:08.668519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:08.668804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] PATH_INFO: `/v3/users/84a5d391e20b465abbed3b114db4fd72` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:08.671429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a5d391e20b465abbed3b114db4fd72)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:08.674418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:08.981092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009d224b4b59428abdd9da29abe86900'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:08.996912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009d224b4b59428abdd9da29abe86900'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.051071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a5d391e20b465abbed3b114db4fd72'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.084896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a5d391e20b465abbed3b114db4fd72'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.086003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a5d391e20b465abbed3b114db4fd72'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.086432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009d224b4b59428abdd9da29abe86900'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.087370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009d224b4b59428abdd9da29abe86900'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.088022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fea9c15f-b618-41ea-acd3-f5fc35f196a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009d224b4b59428abdd9da29abe86900'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.136235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 886/1757] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:08 2022] DELETE /identity/v3/users/009d224b4b59428abdd9da29abe86900 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:09.141351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:09.141770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:09.159360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:09.179121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a5d391e20b465abbed3b114db4fd72'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.181551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f261d61-8172-48c2-8a1b-022fc60ed23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a5d391e20b465abbed3b114db4fd72'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.195598 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:09.197857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:09.211610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 872/1758] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:08 2022] DELETE /identity/v3/users/84a5d391e20b465abbed3b114db4fd72 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:09.216438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:09.217268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:09.217658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:09.288261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:09.290259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:09.388473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:09.419924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 887/1759] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:09.425092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:09.435709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:09.436285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 873/1760] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:09.456179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99d9f9-104d-4654-88c3-fd4fb8115561 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:09.475355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:09.475355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:09.475355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:09.475355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] PATH_INFO: `/v3/projects/9880e611cbd04ed1911f5b294e7d3d13` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:09.475726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9880e611cbd04ed1911f5b294e7d3d13)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:09.475842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:09.475842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:09.503701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:09.657880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194c1eb-dc3a-49fe-b1ba-f435de298c56 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:09.687412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9880e611cbd04ed1911f5b294e7d3d13', 'request_id': 'req-e8fccdad-0249-49f8-a4de-95e812b428a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.835732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9880e611cbd04ed1911f5b294e7d3d13', 'request_id': 'req-e8fccdad-0249-49f8-a4de-95e812b428a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.843226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9880e611cbd04ed1911f5b294e7d3d13', 'request_id': 'req-e8fccdad-0249-49f8-a4de-95e812b428a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.851914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:09.863615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3e7a-bcaa-4564-b71a-5ffc1a508a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:09.875384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3e7a-bcaa-4564-b71a-5ffc1a508a36 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:09.875384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3e7a-bcaa-4564-b71a-5ffc1a508a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:09.875384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3e7a-bcaa-4564-b71a-5ffc1a508a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:09.887871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] The token cache is being invalidate because project 9880e611cbd04ed1911f5b294e7d3d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:09.888173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.890573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:09.927071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 888/1761] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:09 2022] DELETE /identity/v3/projects/9880e611cbd04ed1911f5b294e7d3d13 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:09.927071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:09.927071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:09.962922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fccdad-0249-49f8-a4de-95e812b428a7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:09.967887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1946df0-18ea-478d-ae23-2d63389655c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:09.980956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946df0-18ea-478d-ae23-2d63389655c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:09.981552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946df0-18ea-478d-ae23-2d63389655c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:09.983086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1946df0-18ea-478d-ae23-2d63389655c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:09.990216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1946df0-18ea-478d-ae23-2d63389655c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:10.059055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3e7a-bcaa-4564-b71a-5ffc1a508a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:10.059055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3e7a-bcaa-4564-b71a-5ffc1a508a36 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:10.064030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 874/1762] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:10.072697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb12d10-ac7d-438f-8c5d-3a6982bed950 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:10.072697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb12d10-ac7d-438f-8c5d-3a6982bed950 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:10.072697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb12d10-ac7d-438f-8c5d-3a6982bed950 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:10.072697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 875/1763] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:31:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:31:10.072697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb12d10-ac7d-438f-8c5d-3a6982bed950 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:10.076387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ebb12d10-ac7d-438f-8c5d-3a6982bed950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:10.104674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb12d10-ac7d-438f-8c5d-3a6982bed950 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:10.115481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:10.115481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:10.115481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:10.115481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] PATH_INFO: `/v3/users/d6fd662ba45f45cf89da42734039db1b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:10.116426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fd662ba45f45cf89da42734039db1b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:10.120700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:10.259440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1946df0-18ea-478d-ae23-2d63389655c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:10.265826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1946df0-18ea-478d-ae23-2d63389655c4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:10.279379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 889/1764] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:10.281194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:10.281562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:10.281791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:10.321999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:10.330757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:10.520524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 890/1765] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:10.801233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:10.802776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:10.806758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fd662ba45f45cf89da42734039db1b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:10.819320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cadd3-f553-453f-95dc-19bc18be6646 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:10.825713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:10.826627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:10.826953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:10.827253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:10.839445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:10.844358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:10.844503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fd662ba45f45cf89da42734039db1b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:10.844503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fd662ba45f45cf89da42734039db1b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:10.868031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 891/1766] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:10.961441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fd662ba45f45cf89da42734039db1b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:10.965036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fd662ba45f45cf89da42734039db1b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:11.013849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 876/1767] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:10 2022] DELETE /identity/v3/users/d6fd662ba45f45cf89da42734039db1b => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:11.830282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:12.511956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:12.513402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:12.541441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1d265-c958-4a1a-a7dd-e46013f2e2c4 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:12.655611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:12.662114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:12.662467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:12.662791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] PATH_INFO: `/v3/projects/bfb15196231f43d3a316cd921cd26ca7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:12.666266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb15196231f43d3a316cd921cd26ca7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:12.668407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:12.683987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:12.797504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb15196231f43d3a316cd921cd26ca7', 'request_id': 'req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:12.848433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:12.848433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:12.857866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8f198-2f39-4c66-9f54-5e71dc89b245 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:12.859214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb15196231f43d3a316cd921cd26ca7', 'request_id': 'req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:12.871347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb15196231f43d3a316cd921cd26ca7', 'request_id': 'req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:12.889453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] The token cache is being invalidate because project bfb15196231f43d3a316cd921cd26ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:12.889897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:12.895201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:12.902285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 892/1768] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:12 2022] DELETE /identity/v3/projects/bfb15196231f43d3a316cd921cd26ca7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:12.906141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:12.910152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:13.013837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:13.015260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:13.015556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:13.015838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] PATH_INFO: `/v3/projects/390677b3ddf34610a8cc285e2e793d01` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:13.017416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=390677b3ddf34610a8cc285e2e793d01)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:13.019995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:13.106215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fa0c-e3b7-45d7-8af2-0063ba5fed51 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:13.116961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:13.119159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:13.119159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:13.119159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] PATH_INFO: `/v3/users/2ca61bcc68af4833ada27b04d3eadb2f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:13.124092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca61bcc68af4833ada27b04d3eadb2f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:13.128076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:13.198059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390677b3ddf34610a8cc285e2e793d01', 'request_id': 'req-52eab1ad-0d75-4fa0-86e0-efc0583812dd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.249993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390677b3ddf34610a8cc285e2e793d01', 'request_id': 'req-52eab1ad-0d75-4fa0-86e0-efc0583812dd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.274596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390677b3ddf34610a8cc285e2e793d01', 'request_id': 'req-52eab1ad-0d75-4fa0-86e0-efc0583812dd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.355758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca61bcc68af4833ada27b04d3eadb2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.372829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] The token cache is being invalidate because project 390677b3ddf34610a8cc285e2e793d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:13.376615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.376615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52eab1ad-0d75-4fa0-86e0-efc0583812dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.385881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca61bcc68af4833ada27b04d3eadb2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.393303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 877/1769] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:12 2022] DELETE /identity/v3/projects/390677b3ddf34610a8cc285e2e793d01 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:13.398491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7af80-bbda-4fde-8dd0-c76c6f562ff6 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:13.399021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7af80-bbda-4fde-8dd0-c76c6f562ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:13.399474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7af80-bbda-4fde-8dd0-c76c6f562ff6 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:13.403069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 878/1770] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:31:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:31:13.406467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7af80-bbda-4fde-8dd0-c76c6f562ff6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:13.410358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-03a7af80-bbda-4fde-8dd0-c76c6f562ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:13.516238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca61bcc68af4833ada27b04d3eadb2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.517190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca61bcc68af4833ada27b04d3eadb2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.517923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-458a1cb8-1049-4a36-962c-57d813b12570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca61bcc68af4833ada27b04d3eadb2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:13.552595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 893/1771] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:12 2022] DELETE /identity/v3/users/2ca61bcc68af4833ada27b04d3eadb2f => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:13.578566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:13.586834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7af80-bbda-4fde-8dd0-c76c6f562ff6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:13.629418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:13.629711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:13.630004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:13.661381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:13.662948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:13.678979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:13.721385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:13.730744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:13.731075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:13.731484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] PATH_INFO: `/v3/users/323c6028a0fb47959add1da0edf84c68` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:13.733132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323c6028a0fb47959add1da0edf84c68)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:13.735302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:13.818460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 894/1772] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:31:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:13.834419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:13.868737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:13.905616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba878d9-e8be-4b9f-9fa4-79cf7d68573f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:13.919788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:13.932392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:13.933281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:13.933582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] PATH_INFO: `/v3/projects/713ffe1e1f1c4987b299c3e8e13dfc8c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:13.949098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=713ffe1e1f1c4987b299c3e8e13dfc8c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:13.949098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:14.071711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323c6028a0fb47959add1da0edf84c68'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.085516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323c6028a0fb47959add1da0edf84c68'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.086244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323c6028a0fb47959add1da0edf84c68'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.129686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713ffe1e1f1c4987b299c3e8e13dfc8c', 'request_id': 'req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.149281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323c6028a0fb47959add1da0edf84c68'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.153511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323c6028a0fb47959add1da0edf84c68'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.178683 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 879/1773] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:13 2022] DELETE /identity/v3/users/323c6028a0fb47959add1da0edf84c68 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:14.179804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:14.181737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:14.223417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713ffe1e1f1c4987b299c3e8e13dfc8c', 'request_id': 'req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.230809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713ffe1e1f1c4987b299c3e8e13dfc8c', 'request_id': 'req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.258861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] The token cache is being invalidate because project 713ffe1e1f1c4987b299c3e8e13dfc8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:14.259194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.261379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-901fd4e3-4c04-44ed-a1c2-23d9a3b5ab0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:14.265133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 895/1774] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:13 2022] DELETE /identity/v3/projects/713ffe1e1f1c4987b299c3e8e13dfc8c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:14.270403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a543d-fa03-4c6b-ba3f-ab767a42030d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.270858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a543d-fa03-4c6b-ba3f-ab767a42030d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.271316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a543d-fa03-4c6b-ba3f-ab767a42030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.315152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b90a543d-fa03-4c6b-ba3f-ab767a42030d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:14.321280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094992f4-fa13-4a48-8345-1e1b580dde37 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:14.327542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b90a543d-fa03-4c6b-ba3f-ab767a42030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:14.335379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233686c-b0cc-4269-a72e-7217dcce7e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:14.337947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233686c-b0cc-4269-a72e-7217dcce7e54 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.344123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233686c-b0cc-4269-a72e-7217dcce7e54 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.344123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233686c-b0cc-4269-a72e-7217dcce7e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.344123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3233686c-b0cc-4269-a72e-7217dcce7e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:14.396174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233686c-b0cc-4269-a72e-7217dcce7e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:14.397829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233686c-b0cc-4269-a72e-7217dcce7e54 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:14.415631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 880/1775] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:14.423401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 896/1776] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:14.432222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523eb70-aad5-4b31-baf1-a9517ccea00a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.432515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523eb70-aad5-4b31-baf1-a9517ccea00a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.432797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523eb70-aad5-4b31-baf1-a9517ccea00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.454196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7523eb70-aad5-4b31-baf1-a9517ccea00a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:14.458155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7523eb70-aad5-4b31-baf1-a9517ccea00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:14.469554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 881/1777] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:14.474175 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a543d-fa03-4c6b-ba3f-ab767a42030d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:14.489418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a543d-fa03-4c6b-ba3f-ab767a42030d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:14.505105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:14.505866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.506173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.506476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.519690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:14.520216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:14.521748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:14.538307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 897/1778] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:31:14.542478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523eb70-aad5-4b31-baf1-a9517ccea00a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:14.565498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523eb70-aad5-4b31-baf1-a9517ccea00a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:14.571942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:14.573210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.573696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.574312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.575377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:14.583613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:14.725207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:14.736056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 882/1779] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:14 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:14.744506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ce85-c960-4753-b896-81c510934b47 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:14.841200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:14.934712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:14.935914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:14.936361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:14.936645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:14.937958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:14.941605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.004209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:15.092944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 898/1780] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:14 2022] POST /identity/v3/users => generated 284 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:15.104121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.127344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e02c0-8bf9-4cdd-8171-8f3f83f235a7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.133965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.138321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.138321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.138321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.138321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.138321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.182679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.182876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 883/1781] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:15.200189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f7a2-1d39-44be-ab76-a80f6f316fa3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.211776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acc43f-cd20-4344-a032-eae0a993171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.213553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acc43f-cd20-4344-a032-eae0a993171f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.214081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acc43f-cd20-4344-a032-eae0a993171f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.214569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acc43f-cd20-4344-a032-eae0a993171f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.215610 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acc43f-cd20-4344-a032-eae0a993171f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.218031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acc43f-cd20-4344-a032-eae0a993171f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.231388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 899/1782] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:15.236187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.248260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd418e05-f768-4844-958f-bb0219a73f17 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.260735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.261829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.266182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.266182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] PATH_INFO: `/v3/projects/8ffb70aba4ce4b0fb357069e21e179db/users/aa2f74ac39ff45bf8f2d0c5e982a6afe/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.294576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffb70aba4ce4b0fb357069e21e179db, user_id=aa2f74ac39ff45bf8f2d0c5e982a6afe, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.308449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.414704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 884/1783] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:15 2022] PUT /identity/v3/projects/8ffb70aba4ce4b0fb357069e21e179db/users/aa2f74ac39ff45bf8f2d0c5e982a6afe/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:15.426238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.426797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.427280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.466737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] MFA Rules not processed for user `aa2f74ac39ff45bf8f2d0c5e982a6afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:15.468008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.555933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.557806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.574767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 900/1784] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:15.588982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:15.590757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:15.725581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f44dd-456d-43ed-b9e4-e937f3eed3b8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.732813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.733926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.734360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.734840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] PATH_INFO: `/v3/projects/839fea52cfbb449fa82efd192500c03a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.737329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] RBAC: Authorizing `identity:delete_project(project_id=839fea52cfbb449fa82efd192500c03a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.740081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.744521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516000f8-c61c-4758-97a4-bbb9e1655743 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:15.750752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eabdbf-4b6a-435e-b7bf-a3df379ca6a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:15.753354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eabdbf-4b6a-435e-b7bf-a3df379ca6a9 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:15.753804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eabdbf-4b6a-435e-b7bf-a3df379ca6a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:15.754374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eabdbf-4b6a-435e-b7bf-a3df379ca6a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:15.764693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eabdbf-4b6a-435e-b7bf-a3df379ca6a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:15.766536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eabdbf-4b6a-435e-b7bf-a3df379ca6a9 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:15.780815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 901/1785] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:15.946910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839fea52cfbb449fa82efd192500c03a', 'request_id': 'req-ac1293ed-e997-4049-8539-47f0b60c866e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:15.959165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839fea52cfbb449fa82efd192500c03a', 'request_id': 'req-ac1293ed-e997-4049-8539-47f0b60c866e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:15.972550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839fea52cfbb449fa82efd192500c03a', 'request_id': 'req-ac1293ed-e997-4049-8539-47f0b60c866e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.071508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] The token cache is being invalidate because project 839fea52cfbb449fa82efd192500c03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:16.072053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.076848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac1293ed-e997-4049-8539-47f0b60c866e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:16.078923 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 885/1786] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:15 2022] DELETE /identity/v3/projects/839fea52cfbb449fa82efd192500c03a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:16.084147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.084441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.084886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.105612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:16.111632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:16.179745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:16.191564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 902/1787] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:16.200122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df79eb9-0f75-4555-8e3a-395e881ec9cc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.200736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df79eb9-0f75-4555-8e3a-395e881ec9cc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.201084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df79eb9-0f75-4555-8e3a-395e881ec9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.236792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1df79eb9-0f75-4555-8e3a-395e881ec9cc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:16.245541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1df79eb9-0f75-4555-8e3a-395e881ec9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:16.248480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:16.250412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:16.265399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 886/1788] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:16.268585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14348b2b-cbd1-4488-a2f0-8ca916c7166d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:16.270226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df79eb9-0f75-4555-8e3a-395e881ec9cc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:16.288904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:16.290245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.293608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df79eb9-0f75-4555-8e3a-395e881ec9cc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:16.295961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.296834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] PATH_INFO: `/v3/projects/f7ddd7f1d850427e92a4debaf0aed174` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.300325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ddd7f1d850427e92a4debaf0aed174)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:16.305345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.310542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:16.312409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.314332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.314699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.315619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:16.316639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:16.321333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.350782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 887/1789] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:16.369720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:16.391187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68864ec-77fa-42bc-b1c5-32460c8c51ea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:16.391187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:16.391187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:16.391912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:16.392433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:16.393320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:16.395396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:16.409600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:17.023096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ddd7f1d850427e92a4debaf0aed174', 'request_id': 'req-73022cf2-b9cb-49ff-b29d-08249673b3fb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.024545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 888/1790] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:16 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:17.024545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.024545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fae7d5-fb5e-4640-98a5-b702797271f6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.024545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.027424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.027424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.027424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.027424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.027424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.030140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ddd7f1d850427e92a4debaf0aed174', 'request_id': 'req-73022cf2-b9cb-49ff-b29d-08249673b3fb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.037208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ddd7f1d850427e92a4debaf0aed174', 'request_id': 'req-73022cf2-b9cb-49ff-b29d-08249673b3fb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.048339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] The token cache is being invalidate because project f7ddd7f1d850427e92a4debaf0aed174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:17.048629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.049290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73022cf2-b9cb-49ff-b29d-08249673b3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:17.050950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 903/1791] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:16 2022] DELETE /identity/v3/projects/f7ddd7f1d850427e92a4debaf0aed174 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:17.061758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c6319-5137-4fbd-b4ae-0d6955389953 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.062068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c6319-5137-4fbd-b4ae-0d6955389953 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.062389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c6319-5137-4fbd-b4ae-0d6955389953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.080966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-af0c6319-5137-4fbd-b4ae-0d6955389953 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:17.082210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af0c6319-5137-4fbd-b4ae-0d6955389953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.090088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 904/1792] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:17.099264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802185f9-bf77-40a7-8085-e881e59d89a1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.099557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802185f9-bf77-40a7-8085-e881e59d89a1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.099852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802185f9-bf77-40a7-8085-e881e59d89a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.115191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 889/1793] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:16 2022] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:17.131643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-802185f9-bf77-40a7-8085-e881e59d89a1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:17.131643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-802185f9-bf77-40a7-8085-e881e59d89a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.131643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 905/1794] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:17.134636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.134859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802185f9-bf77-40a7-8085-e881e59d89a1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.136372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.145535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802185f9-bf77-40a7-8085-e881e59d89a1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.149330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336025e-4b9a-4bba-a898-2bb2c4a0f3ce admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.149809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.150461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.150788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.151073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.151804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:17.152134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.153768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.165926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.169172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.169172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.169172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.169710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 906/1795] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:31:17.172752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.174150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.174837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.185587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593f3fc-76bb-4317-9370-ff8028a7b38e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.189042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 890/1796] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:17.193781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.193781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.193781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.193781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.194246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.195221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.195756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.208578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64d15b-6ff1-4e00-810c-651c010a4329 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.215121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.215916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.216227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.216715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.217561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.219246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.231133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 891/1797] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:17.235359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.245444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acf5d0-459a-4929-bd01-1802b3fd2768 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.250418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edbd4c-0a6a-493b-a98e-eadde348d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.251889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edbd4c-0a6a-493b-a98e-eadde348d90a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.251889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edbd4c-0a6a-493b-a98e-eadde348d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.260586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edbd4c-0a6a-493b-a98e-eadde348d90a admin admin] PATH_INFO: `/v3/projects/0b1c7510420f498a96c7e8d7ec09261e/users/1b1502443a4a401d80b752b750aaa56b/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.268533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edbd4c-0a6a-493b-a98e-eadde348d90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1c7510420f498a96c7e8d7ec09261e, user_id=1b1502443a4a401d80b752b750aaa56b, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.271382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edbd4c-0a6a-493b-a98e-eadde348d90a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.400030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 907/1798] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/projects => generated 389 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:17.406050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.443467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 892/1799] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:17 2022] PUT /identity/v3/projects/0b1c7510420f498a96c7e8d7ec09261e/users/1b1502443a4a401d80b752b750aaa56b/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:17.457877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0d2c-f987-47df-aa6e-08753532a1a5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.458246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0d2c-f987-47df-aa6e-08753532a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.458590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0d2c-f987-47df-aa6e-08753532a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.485063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d909b2-8181-4864-94fb-4b5cfb7d028d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.518524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-554a0d2c-f987-47df-aa6e-08753532a1a5 None None] MFA Rules not processed for user `1b1502443a4a401d80b752b750aaa56b`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:17.519817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-554a0d2c-f987-47df-aa6e-08753532a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:17.562933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.563755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.564687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.564966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.565660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.567648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.602052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 893/1800] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:17.608356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a0d2c-f987-47df-aa6e-08753532a1a5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.619166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a0d2c-f987-47df-aa6e-08753532a1a5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.623842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.624617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.624860 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.625226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.625863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.628520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.712817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 908/1801] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/users => generated 295 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:17.718864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.724147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e5cb-0a7d-413b-a35e-0bd6d1dbc3af admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.729778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.730487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.730817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.731101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.731840 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.733457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.747062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 894/1802] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:17.750309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.755430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 909/1803] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:17.759158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.770779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3017b-6d8f-46ef-89ec-41b3cf72e0e3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.819480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c188c61-010c-4f9b-8163-77c0593e4e7c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.826524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.827252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.827542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.827826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.828530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.830847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.837215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.837902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.840373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.840373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.840373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.840814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:17.851312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 910/1804] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:17.855577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:17.866361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc89eec-74a2-481a-ac81-885fafbb00fb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:17.870824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:17.873180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8503c1-6b99-4a21-8e79-ba42ae2dbeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:17.874071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8503c1-6b99-4a21-8e79-ba42ae2dbeec admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:17.874351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8503c1-6b99-4a21-8e79-ba42ae2dbeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:17.874624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8503c1-6b99-4a21-8e79-ba42ae2dbeec admin admin] PATH_INFO: `/v3/projects/47d2a0311d844bd5aac03a322a703c0f/users/b6ce7bdc36a345e59c87491d514b3732/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:17.889775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8503c1-6b99-4a21-8e79-ba42ae2dbeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d2a0311d844bd5aac03a322a703c0f, user_id=b6ce7bdc36a345e59c87491d514b3732, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:17.893123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8503c1-6b99-4a21-8e79-ba42ae2dbeec admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.018648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 895/1805] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:17 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:18.022408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.032252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3961c20-9f87-47a4-aaa8-fef3cbdfa202 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.036811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.038797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.039125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.039409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.040206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.041987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.052721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 896/1806] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:18.062313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.065500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 911/1807] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:17 2022] PUT /identity/v3/projects/47d2a0311d844bd5aac03a322a703c0f/users/b6ce7bdc36a345e59c87491d514b3732/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:18.070751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742354de-a339-4ebd-bd4d-50356225bc45 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.075833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c1c9-bf0e-49d6-9bdd-77c55e519e91 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.076127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c1c9-bf0e-49d6-9bdd-77c55e519e91 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.076409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c1c9-bf0e-49d6-9bdd-77c55e519e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.106445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d112c1c9-bf0e-49d6-9bdd-77c55e519e91 None None] MFA Rules not processed for user `b6ce7bdc36a345e59c87491d514b3732`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:18.114245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d112c1c9-bf0e-49d6-9bdd-77c55e519e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:18.147973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.151138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.151138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.151138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.151138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.151908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.166896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 897/1808] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:18.172303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.183234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d2453-df13-4b2f-89e2-e6fff994affc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.195067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558ca1f-bb03-439b-a8fa-c883c1b9d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.195957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 912/1809] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:18.196054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ca1f-bb03-439b-a8fa-c883c1b9d441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.196054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ca1f-bb03-439b-a8fa-c883c1b9d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.196054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ca1f-bb03-439b-a8fa-c883c1b9d441 admin admin] PATH_INFO: `/v3/projects/8aea60a9418741d4bcf1e9ddd59fd0e1/users/c28ef61feb1245ceb79864d3c6e59647/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.198371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112c1c9-bf0e-49d6-9bdd-77c55e519e91 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.210194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112c1c9-bf0e-49d6-9bdd-77c55e519e91 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.215110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.215286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558ca1f-bb03-439b-a8fa-c883c1b9d441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aea60a9418741d4bcf1e9ddd59fd0e1, user_id=c28ef61feb1245ceb79864d3c6e59647, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.215767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.216053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.216331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.217023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.218881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558ca1f-bb03-439b-a8fa-c883c1b9d441 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.218994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.373112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 898/1810] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:18 2022] PUT /identity/v3/projects/8aea60a9418741d4bcf1e9ddd59fd0e1/users/c28ef61feb1245ceb79864d3c6e59647/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:18.384751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290f7c0-7956-4bb3-9195-0e81f76a2ee8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.385046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290f7c0-7956-4bb3-9195-0e81f76a2ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.385332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290f7c0-7956-4bb3-9195-0e81f76a2ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.420110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 913/1811] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:18.420373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e290f7c0-7956-4bb3-9195-0e81f76a2ee8 None None] MFA Rules not processed for user `c28ef61feb1245ceb79864d3c6e59647`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:18.420373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e290f7c0-7956-4bb3-9195-0e81f76a2ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:18.424066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.499468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 899/1812] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:18.505668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290f7c0-7956-4bb3-9195-0e81f76a2ee8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.506464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769d9b0-89ab-457e-9101-7fcf45cbfdbf admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.521466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.523177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.523177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.523567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.524331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.524733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290f7c0-7956-4bb3-9195-0e81f76a2ee8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.526449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.530320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.531005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.531290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.531675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.532484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.534420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.680346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 914/1813] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/users => generated 300 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:18.683524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.698717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 900/1814] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:18.699845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.700672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9a9be-6011-4d13-afd5-2bd34acccb1f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.771743 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:18.792031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.795383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.795904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.799593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.805952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.805952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.806173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4980-3680-4e8e-8934-0ae9e64890ff admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.809127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.810002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.810321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.810610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.811491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.813985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:18.815897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 915/1815] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:18.821168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:18.832519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab03e-5e7a-473d-85b4-babe75276b65 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:18.837835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:18.838825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:18.839113 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:18.839390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] PATH_INFO: `/v3/projects/ae19ca6c957d49a6b42c8d2d22c3a22a/users/b3910d46e2ad4aaaa7525c657fdbcd72/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:18.861510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae19ca6c957d49a6b42c8d2d22c3a22a, user_id=b3910d46e2ad4aaaa7525c657fdbcd72, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:18.863369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.024039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 901/1816] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:18 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:19.028157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.040457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42438a27-6f16-4653-9697-064c19d24841 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.046490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.046490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.046490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.046854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.047387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.050297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.074203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 902/1817] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:19.076871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.089607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d6a87-3fa9-418b-8dcd-9e1adb842da4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.094385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.096426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.096577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.096846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] PATH_INFO: `/v3/projects/a801c0f12f81452195ee53394d34ceec/users/9582d9e3fe7842f2be6d851bf6c21821/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.119042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a801c0f12f81452195ee53394d34ceec, user_id=9582d9e3fe7842f2be6d851bf6c21821, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.121654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.172233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 916/1818] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:18 2022] PUT /identity/v3/projects/ae19ca6c957d49a6b42c8d2d22c3a22a/users/b3910d46e2ad4aaaa7525c657fdbcd72/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:19.198062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.274153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5a2ba-bd42-4808-8a08-03480c7f81bb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.277873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 903/1819] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:19 2022] PUT /identity/v3/projects/a801c0f12f81452195ee53394d34ceec/users/9582d9e3fe7842f2be6d851bf6c21821/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:19.294999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.376723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.377059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.377291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.377619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.378428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.380187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.393153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 917/1820] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:19.397230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.406957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26333c0f-69a1-4366-b4e3-85da220f889d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.408779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e296acc-ec80-41e5-ad39-39f0217d5f67 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.413435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.414171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.414384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba151cd-4ff3-4644-9383-2732eede466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.414520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.414820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.415581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.415895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba151cd-4ff3-4644-9383-2732eede466a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.416311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba151cd-4ff3-4644-9383-2732eede466a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.416731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba151cd-4ff3-4644-9383-2732eede466a admin admin] PATH_INFO: `/v3/projects/ae19ca6c957d49a6b42c8d2d22c3a22a/users/b3910d46e2ad4aaaa7525c657fdbcd72/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.417256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.419913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba151cd-4ff3-4644-9383-2732eede466a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae19ca6c957d49a6b42c8d2d22c3a22a, user_id=b3910d46e2ad4aaaa7525c657fdbcd72, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.431098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba151cd-4ff3-4644-9383-2732eede466a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.431202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 904/1821] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:19.433367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.435421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 918/1822] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:19 2022] PUT /identity/v3/projects/ae19ca6c957d49a6b42c8d2d22c3a22a/users/b3910d46e2ad4aaaa7525c657fdbcd72/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:19.447036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.447352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a042-1c13-4687-b751-9bab8b601106 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.447555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.447653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.480476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] MFA Rules not processed for user `b3910d46e2ad4aaaa7525c657fdbcd72`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:19.481876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:19.533881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e54c-88d9-4f8e-9dea-5b40fd52c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.534965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e54c-88d9-4f8e-9dea-5b40fd52c0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.535274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e54c-88d9-4f8e-9dea-5b40fd52c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.535760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e54c-88d9-4f8e-9dea-5b40fd52c0af admin admin] PATH_INFO: `/v3/projects/a801c0f12f81452195ee53394d34ceec/users/9582d9e3fe7842f2be6d851bf6c21821/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.538163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1e54c-88d9-4f8e-9dea-5b40fd52c0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a801c0f12f81452195ee53394d34ceec, user_id=9582d9e3fe7842f2be6d851bf6c21821, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.541649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1e54c-88d9-4f8e-9dea-5b40fd52c0af admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.557817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 905/1823] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:19 2022] PUT /identity/v3/projects/a801c0f12f81452195ee53394d34ceec/users/9582d9e3fe7842f2be6d851bf6c21821/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:19.583374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.583374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.583374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.609364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 919/1824] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:19.626876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.628417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:19.656841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] MFA Rules not processed for user `9582d9e3fe7842f2be6d851bf6c21821`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:19.656841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:19.705825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134154e-5682-4f6f-821a-6417fb574e81 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.738400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 906/1825] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:19.750622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:19.753387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:19.765683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.766337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.767691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.767975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.821210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548e288-5d6b-4582-abc6-7cca0f571cb1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:19.824961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:19.825620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:19.825904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:19.826181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:19.836433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.837883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.850713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 907/1826] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:19.852912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:19.854865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:19.866444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 920/1827] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:20.046318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:20.058776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:20.060481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48022ffd-8272-44d2-9c42-39bd8ad35b19 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:20.073867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a383b5e-2334-43e4-91e9-ac6cd45726f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:20.073867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383b5e-2334-43e4-91e9-ac6cd45726f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:20.073867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383b5e-2334-43e4-91e9-ac6cd45726f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:20.073867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383b5e-2334-43e4-91e9-ac6cd45726f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:20.140750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a383b5e-2334-43e4-91e9-ac6cd45726f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:20.142799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a383b5e-2334-43e4-91e9-ac6cd45726f2 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:20.148149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8d362-c258-46bd-ae6f-d0a9c9fa1ab7 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:20.152907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 908/1828] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:20.155576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:20.155576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:20.155576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:20.155958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] PATH_INFO: `/v3/users/b6ce7bdc36a345e59c87491d514b3732` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:20.157812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ce7bdc36a345e59c87491d514b3732)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:20.159988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:20.294910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:20.489034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ce7bdc36a345e59c87491d514b3732'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:20.504096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:20.513707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ce7bdc36a345e59c87491d514b3732'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:20.640615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ce7bdc36a345e59c87491d514b3732'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:20.641262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ce7bdc36a345e59c87491d514b3732'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:20.641966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ce7bdc36a345e59c87491d514b3732'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:20.655537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 921/1829] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:20 2022] DELETE /identity/v3/users/b6ce7bdc36a345e59c87491d514b3732 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:20.662509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:20.663150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:20.663628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:20.687275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:20.690127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:20.752854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 909/1830] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:20.763792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:20.765261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:20.828557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb13b7-b5bb-4c72-a417-25cbcec749f0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:20.833067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:20.842982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:20.842982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:20.842982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:20.845740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:20.847197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:20.858196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 922/1831] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:21.362926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:21.364425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:21.378332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55c03e-9dc8-4657-ad31-681c5f7960e8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:21.383778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:21.384036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:21.384674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:21.384960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:21.385264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] PATH_INFO: `/v3/projects/47d2a0311d844bd5aac03a322a703c0f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:21.386542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d2a0311d844bd5aac03a322a703c0f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:21.388771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:21.502174 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d2a0311d844bd5aac03a322a703c0f', 'request_id': 'req-65733868-70f8-47b8-902e-1bc2c83c7a7f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.510752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d2a0311d844bd5aac03a322a703c0f', 'request_id': 'req-65733868-70f8-47b8-902e-1bc2c83c7a7f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.530173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d2a0311d844bd5aac03a322a703c0f', 'request_id': 'req-65733868-70f8-47b8-902e-1bc2c83c7a7f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.550289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:21.664076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] The token cache is being invalidate because project 47d2a0311d844bd5aac03a322a703c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:21.664369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.665019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:21.666806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 910/1832] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:21 2022] DELETE /identity/v3/projects/47d2a0311d844bd5aac03a322a703c0f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:21.671237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:21.681908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0764f-ac7c-487c-abb4-232460afa70f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:21.743781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:21.744876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:21.745332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:21.745747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] PATH_INFO: `/v3/users/b3910d46e2ad4aaaa7525c657fdbcd72` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:21.747462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3910d46e2ad4aaaa7525c657fdbcd72)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:21.750040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:22.067082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3910d46e2ad4aaaa7525c657fdbcd72'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.079395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3910d46e2ad4aaaa7525c657fdbcd72'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.160337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3910d46e2ad4aaaa7525c657fdbcd72'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.160982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3910d46e2ad4aaaa7525c657fdbcd72'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.161616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85498ea7-9312-41d4-8b4b-7f9de056dd66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3910d46e2ad4aaaa7525c657fdbcd72'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.175490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 923/1833] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:21 2022] DELETE /identity/v3/users/b3910d46e2ad4aaaa7525c657fdbcd72 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:22.287066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:22.395208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:22.673814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:22.676557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:22.691594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733868-70f8-47b8-902e-1bc2c83c7a7f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:22.761526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:22.762714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:22.763026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:22.763312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] PATH_INFO: `/v3/projects/ae19ca6c957d49a6b42c8d2d22c3a22a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:22.764880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae19ca6c957d49a6b42c8d2d22c3a22a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:22.767696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:22.899169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae19ca6c957d49a6b42c8d2d22c3a22a', 'request_id': 'req-59880f11-b6d9-4afb-806f-634a95682d1d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.905839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae19ca6c957d49a6b42c8d2d22c3a22a', 'request_id': 'req-59880f11-b6d9-4afb-806f-634a95682d1d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:22.922679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae19ca6c957d49a6b42c8d2d22c3a22a', 'request_id': 'req-59880f11-b6d9-4afb-806f-634a95682d1d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:23.035321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:23.040519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] The token cache is being invalidate because project ae19ca6c957d49a6b42c8d2d22c3a22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:23.040932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:23.041582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-59880f11-b6d9-4afb-806f-634a95682d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:23.043206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 911/1834] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:22 2022] DELETE /identity/v3/projects/ae19ca6c957d49a6b42c8d2d22c3a22a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:23.048156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61761aa-ae15-4a3d-b2b7-6aee297d366b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.048449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61761aa-ae15-4a3d-b2b7-6aee297d366b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.048732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61761aa-ae15-4a3d-b2b7-6aee297d366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.067436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c61761aa-ae15-4a3d-b2b7-6aee297d366b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:23.068691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c61761aa-ae15-4a3d-b2b7-6aee297d366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:23.075856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:23.131239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 924/1835] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:23.138953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f18a4e-7949-405d-9f27-b0d8f6daa37f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.139242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f18a4e-7949-405d-9f27-b0d8f6daa37f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.139523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f18a4e-7949-405d-9f27-b0d8f6daa37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.159370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-18f18a4e-7949-405d-9f27-b0d8f6daa37f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:23.160583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-18f18a4e-7949-405d-9f27-b0d8f6daa37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:23.179109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 912/1836] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:23.179391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61761aa-ae15-4a3d-b2b7-6aee297d366b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:23.185377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61761aa-ae15-4a3d-b2b7-6aee297d366b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:23.190682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:23.191352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.191646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.191925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.192661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:23.192969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:23.194559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:23.207710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 925/1837] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:23.213662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f18a4e-7949-405d-9f27-b0d8f6daa37f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:23.221322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f18a4e-7949-405d-9f27-b0d8f6daa37f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:23.226158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:23.226853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.227456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.227721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.228486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:23.230803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:23.390996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 913/1838] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:23 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:23.404194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:23.414542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd43b96-ac7f-4505-be10-e9fa87dcb878 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:23.474007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:23.474722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.475014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.475297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.476003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:23.477930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:23.618828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 926/1839] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:23 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:23.633808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:23.645344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c253fec-1c93-4a88-bf44-3bab78d308fb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:23.650047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:23.650736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.651022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.651312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.652114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:23.653711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:23.666086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 914/1840] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:23.696540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:23.707798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e7bea-b5be-4284-8fe0-2fad83ab3e50 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:23.712754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85daa02-c637-49e5-8fdd-81b99b8aca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:23.713568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85daa02-c637-49e5-8fdd-81b99b8aca9b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.713878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85daa02-c637-49e5-8fdd-81b99b8aca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.714165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85daa02-c637-49e5-8fdd-81b99b8aca9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.714935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85daa02-c637-49e5-8fdd-81b99b8aca9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:23.716527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85daa02-c637-49e5-8fdd-81b99b8aca9b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:23.733630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 927/1841] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:23.737212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:23.747737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3b974-2f03-4370-8407-aadae474e265 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:23.753236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:23.754156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.754443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.754766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] PATH_INFO: `/v3/projects/fcb9b8e5b82f4430b1cd732132d2ed39/users/81717e7f25684f7db3a83f6d75c66b94/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.770235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb9b8e5b82f4430b1cd732132d2ed39, user_id=81717e7f25684f7db3a83f6d75c66b94, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:23.773200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:23.789408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:23.874279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 915/1842] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:23 2022] PUT /identity/v3/projects/fcb9b8e5b82f4430b1cd732132d2ed39/users/81717e7f25684f7db3a83f6d75c66b94/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:23.878232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fb528-b6bf-44c7-b36a-36b7e24fc233 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:23.879525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fb528-b6bf-44c7-b36a-36b7e24fc233 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:23.880082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fb528-b6bf-44c7-b36a-36b7e24fc233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:23.913856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c60fb528-b6bf-44c7-b36a-36b7e24fc233 None None] MFA Rules not processed for user `81717e7f25684f7db3a83f6d75c66b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:23.915264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c60fb528-b6bf-44c7-b36a-36b7e24fc233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:24.014868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 928/1843] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:24.019862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:24.098405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30994d4-bd6b-4ce8-b5a9-159bdd816c61 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:24.103048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:24.103714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.103998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.104275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.104971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:24.106968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:24.193691 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 916/1844] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:24 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:24.193810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fb528-b6bf-44c7-b36a-36b7e24fc233 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:24.200662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fb528-b6bf-44c7-b36a-36b7e24fc233 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:24.260319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:24.261003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.262842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.262842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.263127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:24.267239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:24.398789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 929/1845] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:24 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:24.401802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:24.413280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459f819-841e-4613-bf26-7db21ca5fe33 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:24.418841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:24.419668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.420058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.420491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.421541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:24.428024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:24.435990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 917/1846] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:24.440248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:24.451526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1b341-18eb-485b-ba39-2636615a2c93 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:24.457469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:24.458676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.458790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.459365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] PATH_INFO: `/v3/projects/65d6b49793294b4584ac5b50410fb86a/users/8b9d7ba651b2480a9de46952badf6a31/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.476216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d6b49793294b4584ac5b50410fb86a, user_id=8b9d7ba651b2480a9de46952badf6a31, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:24.479036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:24.544435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 930/1847] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:24 2022] PUT /identity/v3/projects/65d6b49793294b4584ac5b50410fb86a/users/8b9d7ba651b2480a9de46952badf6a31/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:24.548861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:24.559825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45ea5-2f4b-4220-9248-136a2748b089 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:24.562193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:24.619788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287455ea-eebf-4c60-83a0-d12a4bd42233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:24.620466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287455ea-eebf-4c60-83a0-d12a4bd42233 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.620749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287455ea-eebf-4c60-83a0-d12a4bd42233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.621027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287455ea-eebf-4c60-83a0-d12a4bd42233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.621763 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287455ea-eebf-4c60-83a0-d12a4bd42233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:24.623398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287455ea-eebf-4c60-83a0-d12a4bd42233 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:24.633826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 918/1848] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:24.638050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:24.649835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f32b-6e8b-4c4d-b1e7-1b7befd76b0b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:24.655000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:24.657784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.657784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.657784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] PATH_INFO: `/v3/projects/65d6b49793294b4584ac5b50410fb86a/users/8b9d7ba651b2480a9de46952badf6a31/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.659306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d6b49793294b4584ac5b50410fb86a, user_id=8b9d7ba651b2480a9de46952badf6a31, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:24.661937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:24.676767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 931/1849] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:24 2022] PUT /identity/v3/projects/65d6b49793294b4584ac5b50410fb86a/users/8b9d7ba651b2480a9de46952badf6a31/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:24.692816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93b80-5f6c-456e-a89e-23efa28d8d33 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.692816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93b80-5f6c-456e-a89e-23efa28d8d33 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.692816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef93b80-5f6c-456e-a89e-23efa28d8d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.720668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cef93b80-5f6c-456e-a89e-23efa28d8d33 None None] MFA Rules not processed for user `8b9d7ba651b2480a9de46952badf6a31`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:24.721899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cef93b80-5f6c-456e-a89e-23efa28d8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:24.798839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 919/1850] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:24.809884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:24.811754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:24.871718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faa22a-8e55-4299-bd9c-4bd30e7e60fa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:24.875514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:24.876662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:24.876945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:24.877223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:24.886713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:24.888155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:24.898111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 932/1851] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:25.205171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93b80-5f6c-456e-a89e-23efa28d8d33 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:25.217489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef93b80-5f6c-456e-a89e-23efa28d8d33 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:25.221063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a71da-83d3-41d2-9bfd-120e43bd36aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:25.221707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a71da-83d3-41d2-9bfd-120e43bd36aa service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:25.221990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a71da-83d3-41d2-9bfd-120e43bd36aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:25.222265 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a71da-83d3-41d2-9bfd-120e43bd36aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:25.296118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a71da-83d3-41d2-9bfd-120e43bd36aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:25.298123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a71da-83d3-41d2-9bfd-120e43bd36aa service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:25.307508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 920/1852] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:25.463595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:25.945751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:25.947520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:26.068085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975239fe-47f9-404f-8eda-8ad9cab7063f service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:26.072655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:26.073565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:26.073853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:26.074134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] PATH_INFO: `/v3/users/1b1502443a4a401d80b752b750aaa56b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:26.075372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1502443a4a401d80b752b750aaa56b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:26.077389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:26.370293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1502443a4a401d80b752b750aaa56b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:26.386587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1502443a4a401d80b752b750aaa56b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:26.521106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1502443a4a401d80b752b750aaa56b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:26.522534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1502443a4a401d80b752b750aaa56b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:26.522869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1502443a4a401d80b752b750aaa56b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:26.539289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 933/1853] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:25 2022] DELETE /identity/v3/users/1b1502443a4a401d80b752b750aaa56b => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:26.543914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:26.544395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:26.544504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:26.563886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:26.565316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:26.566498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:26.575496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:26.628167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 921/1854] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:26.637567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:26.649716 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:26.696608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d1b2-89c0-435c-9f71-e460d54a4bce admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:26.700248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:26.700892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:26.701174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:26.701449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:26.711971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:26.713606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:26.724668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 934/1855] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:27.174274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:27.176293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:27.188458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ebe2-01ba-489c-bdc6-37b1ad98aedb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:27.200503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:27.201451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:27.201741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:27.202019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] PATH_INFO: `/v3/projects/0b1c7510420f498a96c7e8d7ec09261e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:27.203307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1c7510420f498a96c7e8d7ec09261e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:27.205445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:27.355461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1c7510420f498a96c7e8d7ec09261e', 'request_id': 'req-979e57e7-18fc-491b-b2da-e48a67f15655'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:27.360949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1c7510420f498a96c7e8d7ec09261e', 'request_id': 'req-979e57e7-18fc-491b-b2da-e48a67f15655'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:27.367248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1c7510420f498a96c7e8d7ec09261e', 'request_id': 'req-979e57e7-18fc-491b-b2da-e48a67f15655'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:27.475519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] The token cache is being invalidate because project 0b1c7510420f498a96c7e8d7ec09261e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:27.484262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:27.484262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:27.484262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 922/1856] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:27 2022] DELETE /identity/v3/projects/0b1c7510420f498a96c7e8d7ec09261e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:27.487154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:27.496880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91493804-2641-4afd-80c2-122357682b3e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:27.545760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:27.557690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:27.558574 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:27.558950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:27.559226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] PATH_INFO: `/v3/users/c28ef61feb1245ceb79864d3c6e59647` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:27.560409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28ef61feb1245ceb79864d3c6e59647)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:27.562393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:27.934925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28ef61feb1245ceb79864d3c6e59647'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:27.948284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28ef61feb1245ceb79864d3c6e59647'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:28.057598 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28ef61feb1245ceb79864d3c6e59647'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:28.058327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28ef61feb1245ceb79864d3c6e59647'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:28.059007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d46b544d-ea48-4df3-91e1-38a1d88c5a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28ef61feb1245ceb79864d3c6e59647'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:28.072643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 935/1857] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:27 2022] DELETE /identity/v3/users/c28ef61feb1245ceb79864d3c6e59647 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:28.625216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:28.629935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:28.652403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e57e7-18fc-491b-b2da-e48a67f15655 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:28.745344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:28.746407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:28.746818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:28.747242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] PATH_INFO: `/v3/projects/8aea60a9418741d4bcf1e9ddd59fd0e1` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:28.761063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aea60a9418741d4bcf1e9ddd59fd0e1)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:28.763429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:28.807513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654bb9-cc76-49c0-9dfb-5b6d5db6ca8c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:28.808077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654bb9-cc76-49c0-9dfb-5b6d5db6ca8c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:28.808568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0654bb9-cc76-49c0-9dfb-5b6d5db6ca8c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:28.817182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 936/1858] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:31:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 15:31:28.832816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:28.833459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:28.836577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:28.886002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:28.897285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:28.937100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:28.950854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aea60a9418741d4bcf1e9ddd59fd0e1', 'request_id': 'req-032d3a9d-2ea7-4473-8440-2f94be92ee20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:28.961591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aea60a9418741d4bcf1e9ddd59fd0e1', 'request_id': 'req-032d3a9d-2ea7-4473-8440-2f94be92ee20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:28.971678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aea60a9418741d4bcf1e9ddd59fd0e1', 'request_id': 'req-032d3a9d-2ea7-4473-8440-2f94be92ee20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:28.995732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 937/1859] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:29.077444 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:29.079690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:29.092956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] The token cache is being invalidate because project 8aea60a9418741d4bcf1e9ddd59fd0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:29.093252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.093900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.095135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ae263-758d-47e2-bd69-7c5eac0dd330 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:29.095966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 923/1860] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:28 2022] DELETE /identity/v3/projects/8aea60a9418741d4bcf1e9ddd59fd0e1 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:29.099940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:29.101948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:29.171342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:29.180233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d3a9d-2ea7-4473-8440-2f94be92ee20 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:29.186072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:29.186234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:29.190274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:29.190433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:29.190528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:29.190657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:29.190750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] PATH_INFO: `/v3/users/9582d9e3fe7842f2be6d851bf6c21821` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:29.190850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:29.190937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9582d9e3fe7842f2be6d851bf6c21821)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:29.191020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:29.191807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:29.204636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:29.206354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:29.217899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 938/1861] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:29.481138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9582d9e3fe7842f2be6d851bf6c21821'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.505539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9582d9e3fe7842f2be6d851bf6c21821'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.506293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9582d9e3fe7842f2be6d851bf6c21821'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.595055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9582d9e3fe7842f2be6d851bf6c21821'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.595928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-70a36664-bd0a-4545-9283-69ab322ec121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9582d9e3fe7842f2be6d851bf6c21821'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:29.609894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 924/1862] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:29 2022] DELETE /identity/v3/users/9582d9e3fe7842f2be6d851bf6c21821 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:30.099651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.117934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070977-56ca-4354-b088-35910b4add4e service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.220575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.221734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.222177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.222613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] PATH_INFO: `/v3/projects/a801c0f12f81452195ee53394d34ceec` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.224239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a801c0f12f81452195ee53394d34ceec)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.226503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.374380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a801c0f12f81452195ee53394d34ceec', 'request_id': 'req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:30.534280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a801c0f12f81452195ee53394d34ceec', 'request_id': 'req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:30.540486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a801c0f12f81452195ee53394d34ceec', 'request_id': 'req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:30.552771 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] The token cache is being invalidate because project a801c0f12f81452195ee53394d34ceec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:30.553057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:30.553730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-69bb4fdc-739b-4313-b6f6-68b4121fe6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:30.555316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 939/1863] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:30 2022] DELETE /identity/v3/projects/a801c0f12f81452195ee53394d34ceec => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:30.562194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c98f-c3e6-4c3e-8aca-6aa5d92bbc7f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.562787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c98f-c3e6-4c3e-8aca-6aa5d92bbc7f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.563107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c98f-c3e6-4c3e-8aca-6aa5d92bbc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.582719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8bd1c98f-c3e6-4c3e-8aca-6aa5d92bbc7f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:30.583990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8bd1c98f-c3e6-4c3e-8aca-6aa5d92bbc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:30.648247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:30.648766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 925/1864] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:30.659141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eab88-0088-4e75-973f-06501da4e03d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.659498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eab88-0088-4e75-973f-06501da4e03d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.659795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eab88-0088-4e75-973f-06501da4e03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.681167 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c60eab88-0088-4e75-973f-06501da4e03d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:30.682518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c60eab88-0088-4e75-973f-06501da4e03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:30.691802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 940/1865] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:30.696041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c98f-c3e6-4c3e-8aca-6aa5d92bbc7f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.708050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c98f-c3e6-4c3e-8aca-6aa5d92bbc7f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.712825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.713492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.713775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.722896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.722896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:30.722896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.722896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:30.734786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 926/1866] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:30.736975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eab88-0088-4e75-973f-06501da4e03d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:30.746507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eab88-0088-4e75-973f-06501da4e03d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:30.754464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:30.755210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:30.755451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:30.755732 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:30.756439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:30.758609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:31.026123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 941/1867] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:30 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:31.030310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:31.041195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efce3-ffe4-4af9-ae21-7b93d1a25db3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:31.101552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:31.102222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:31.102504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:31.102813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:31.103506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:31.105417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:31.255327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 927/1868] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:31 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:31.257292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:31.270130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd3737-5e08-4741-bdb4-fb2c40ef6764 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:31.276099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:31.276775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:31.277063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:31.277340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:31.278071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:31.279978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:31.292817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 942/1869] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:31.300083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:31.310077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590323-8cb4-434f-ac15-5e9313c66a03 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:31.315509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88abcf-f00f-477e-a93e-f7695f83f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:31.316161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88abcf-f00f-477e-a93e-f7695f83f31d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:31.317727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88abcf-f00f-477e-a93e-f7695f83f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:31.317727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88abcf-f00f-477e-a93e-f7695f83f31d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:31.317727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88abcf-f00f-477e-a93e-f7695f83f31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:31.319121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88abcf-f00f-477e-a93e-f7695f83f31d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:31.334163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 928/1870] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:31.336093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:31.348889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141697d-89f0-492c-8e58-15e0c247d645 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:31.354371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:31.355479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:31.355742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:31.356014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] PATH_INFO: `/v3/projects/a70ed5d1faf0409c917d691639d49e59/users/1666a7c10ba24774b20e99b38e691493/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:31.377809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70ed5d1faf0409c917d691639d49e59, user_id=1666a7c10ba24774b20e99b38e691493, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:31.382085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:31.619816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 943/1871] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:31 2022] PUT /identity/v3/projects/a70ed5d1faf0409c917d691639d49e59/users/1666a7c10ba24774b20e99b38e691493/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:31.632576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20e12-4df0-4e71-8557-94fb59fcbf23 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:31.633236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20e12-4df0-4e71-8557-94fb59fcbf23 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:31.633583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20e12-4df0-4e71-8557-94fb59fcbf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:31.670686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-99c20e12-4df0-4e71-8557-94fb59fcbf23 None None] MFA Rules not processed for user `1666a7c10ba24774b20e99b38e691493`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:31.672056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-99c20e12-4df0-4e71-8557-94fb59fcbf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:31.741699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 929/1872] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:31.753458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:31.755266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:31.772272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:31.815975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0367d-b297-4471-8e2a-0f37a124306b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:31.819664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c9cde-8630-4c9a-bbb7-106eaf97e699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:31.820318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9cde-8630-4c9a-bbb7-106eaf97e699 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:31.820602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9cde-8630-4c9a-bbb7-106eaf97e699 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:31.820882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9cde-8630-4c9a-bbb7-106eaf97e699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:31.829830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c9cde-8630-4c9a-bbb7-106eaf97e699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:31.831295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c9cde-8630-4c9a-bbb7-106eaf97e699 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:31.840322 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 944/1873] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:31.860504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20e12-4df0-4e71-8557-94fb59fcbf23 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:31.930081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20e12-4df0-4e71-8557-94fb59fcbf23 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:31.935584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:31.938605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:31.938605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:31.939240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:31.939686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] PATH_INFO: `/v3/users/1666a7c10ba24774b20e99b38e691493` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:31.940969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1666a7c10ba24774b20e99b38e691493)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:31.942946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:32.329873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1666a7c10ba24774b20e99b38e691493'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:32.342305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1666a7c10ba24774b20e99b38e691493'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:32.343020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1666a7c10ba24774b20e99b38e691493'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:32.628838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1666a7c10ba24774b20e99b38e691493'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:32.639398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1666a7c10ba24774b20e99b38e691493'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:32.642216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 930/1874] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:31 2022] DELETE /identity/v3/users/1666a7c10ba24774b20e99b38e691493 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:32.651303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:32.651780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:32.651889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:32.669996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:32.679533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:32.732727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 945/1875] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:32.744719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:32.746206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:32.809950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6629c1-0c12-4335-8c05-dc53186f8b00 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:32.814903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a249e8-2021-4393-a512-0444380657fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:32.815659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a249e8-2021-4393-a512-0444380657fa service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:32.815940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a249e8-2021-4393-a512-0444380657fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:32.816224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a249e8-2021-4393-a512-0444380657fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:32.825696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a249e8-2021-4393-a512-0444380657fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:32.827170 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a249e8-2021-4393-a512-0444380657fa service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:32.836990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 931/1876] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:33.827310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:33.829428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:33.843441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae21c9-1846-4bc0-ab0f-6936004d993a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:33.848658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:33.849897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:33.850189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:33.850468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] PATH_INFO: `/v3/projects/a70ed5d1faf0409c917d691639d49e59` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:33.851718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70ed5d1faf0409c917d691639d49e59)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:33.854152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:34.162931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70ed5d1faf0409c917d691639d49e59', 'request_id': 'req-36faaad3-3a9e-4825-98df-a127326f2a2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:34.400631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70ed5d1faf0409c917d691639d49e59', 'request_id': 'req-36faaad3-3a9e-4825-98df-a127326f2a2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:34.408898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70ed5d1faf0409c917d691639d49e59', 'request_id': 'req-36faaad3-3a9e-4825-98df-a127326f2a2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:34.423452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] The token cache is being invalidate because project a70ed5d1faf0409c917d691639d49e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:34.423452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:34.424103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36faaad3-3a9e-4825-98df-a127326f2a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:34.426211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 946/1877] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:33 2022] DELETE /identity/v3/projects/a70ed5d1faf0409c917d691639d49e59 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:34.433980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0236f-392b-4a15-b72d-ccd63490f14d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:34.434545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0236f-392b-4a15-b72d-ccd63490f14d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:34.434764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0236f-392b-4a15-b72d-ccd63490f14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:34.454886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-11b0236f-392b-4a15-b72d-ccd63490f14d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:34.456366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-11b0236f-392b-4a15-b72d-ccd63490f14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:34.593409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 932/1878] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:34.602807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcef96-beaa-4c56-bb94-90805d3fa71a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:34.603387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcef96-beaa-4c56-bb94-90805d3fa71a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:34.603880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcef96-beaa-4c56-bb94-90805d3fa71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:34.632499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a5bcef96-beaa-4c56-bb94-90805d3fa71a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:34.633773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a5bcef96-beaa-4c56-bb94-90805d3fa71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:34.642154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 947/1879] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:34.647262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0236f-392b-4a15-b72d-ccd63490f14d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:34.658823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0236f-392b-4a15-b72d-ccd63490f14d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:34.663981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:34.687543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:34.687543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:34.687543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:34.687543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:34.687543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:34.687543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:34.688429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:34.691882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 933/1880] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:34.695997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcef96-beaa-4c56-bb94-90805d3fa71a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:34.707805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcef96-beaa-4c56-bb94-90805d3fa71a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:34.712408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:34.713058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:34.713341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:34.713614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:34.714332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:34.716248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:34.810023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:34.811883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:34.824795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53992-9724-4bab-8c2b-70ca2ede803e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:34.830204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:34.831136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:34.831423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:34.831700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] PATH_INFO: `/v3/users/81717e7f25684f7db3a83f6d75c66b94` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:34.833076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81717e7f25684f7db3a83f6d75c66b94)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:34.835066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:34.896368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 948/1881] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:34 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:34.899280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:34.914522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:34.979075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c644ea2-8d70-48cb-9e75-08ee3ef7a211 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:34.984681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:34.986269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:34.986269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:34.986269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:34.987090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:34.989106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:35.258671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 949/1882] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:34 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:31:35.262623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:35.273408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500edfc1-4de1-442c-be49-3971574799da admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:35.278118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:35.278825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:35.279132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:35.282389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:35.282389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:35.282389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:35.294915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81717e7f25684f7db3a83f6d75c66b94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:35.306916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 950/1883] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:35.308813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:35.314596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81717e7f25684f7db3a83f6d75c66b94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:35.315358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81717e7f25684f7db3a83f6d75c66b94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:35.325130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30749aee-2d1c-4c87-b85b-425e359393e2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:35.331445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:35.332135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:35.332418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:35.332697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:35.333434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:35.335084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:35.346940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 951/1884] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:35.351120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:35.353020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:35.366700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffd63a-c4f0-4a3e-a15e-9be5d633e713 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:35.371488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfba874-a82b-4e2d-8793-859dfd91f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:35.372428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfba874-a82b-4e2d-8793-859dfd91f774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:35.372721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfba874-a82b-4e2d-8793-859dfd91f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:35.373002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfba874-a82b-4e2d-8793-859dfd91f774 admin admin] PATH_INFO: `/v3/projects/3f756cddc30a4f33b66772529334d8a8/users/0cb483ff24aa45cd9ce01152374c9e4e/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:35.388705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfba874-a82b-4e2d-8793-859dfd91f774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f756cddc30a4f33b66772529334d8a8, user_id=0cb483ff24aa45cd9ce01152374c9e4e, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:35.391691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfba874-a82b-4e2d-8793-859dfd91f774 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:35.428754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81717e7f25684f7db3a83f6d75c66b94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:35.429387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-19239452-1fc7-4496-b2e6-481fbce2e0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81717e7f25684f7db3a83f6d75c66b94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:35.443886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 934/1885] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:34 2022] DELETE /identity/v3/users/81717e7f25684f7db3a83f6d75c66b94 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:35.448399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:35.448719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:35.449007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:35.468617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:35.469900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:35.531648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 935/1886] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:35.541636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:35.543012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:35.575457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 952/1887] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:35 2022] PUT /identity/v3/projects/3f756cddc30a4f33b66772529334d8a8/users/0cb483ff24aa45cd9ce01152374c9e4e/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:35.581106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5ac5-0542-4a0f-905e-aa27b3cd7272 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:35.586763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5ac5-0542-4a0f-905e-aa27b3cd7272 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:35.586763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee5ac5-0542-4a0f-905e-aa27b3cd7272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:35.600794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-09ee5ac5-0542-4a0f-905e-aa27b3cd7272 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:35.602012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-09ee5ac5-0542-4a0f-905e-aa27b3cd7272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:35.607149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f4e46-dafc-418f-afd4-1402383b2efa None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:35.661922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:35.662724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:35.663012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:35.663285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:35.673095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 953/1888] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:35.675668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:35.677159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:35.686982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5ac5-0542-4a0f-905e-aa27b3cd7272 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:35.687896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 936/1889] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:35.698900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee5ac5-0542-4a0f-905e-aa27b3cd7272 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:35.703512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:35.704256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:35.704634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:35.705213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:35.715977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:35.717479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:35.729562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 954/1890] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:36.447256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:36.448982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:36.465101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4155-94f3-44da-95a4-bd091ddcdb03 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:36.473663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:36.473663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:36.473663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:36.474314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] PATH_INFO: `/v3/projects/fcb9b8e5b82f4430b1cd732132d2ed39` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:36.477257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb9b8e5b82f4430b1cd732132d2ed39)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:36.479611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:36.760870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb9b8e5b82f4430b1cd732132d2ed39', 'request_id': 'req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:36.767869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb9b8e5b82f4430b1cd732132d2ed39', 'request_id': 'req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:36.774162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb9b8e5b82f4430b1cd732132d2ed39', 'request_id': 'req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.052480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] The token cache is being invalidate because project fcb9b8e5b82f4430b1cd732132d2ed39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:37.052480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.052480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.052480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 937/1891] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:36 2022] DELETE /identity/v3/projects/fcb9b8e5b82f4430b1cd732132d2ed39 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:37.053485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:37.063576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941bca8-0896-4cbb-801c-70cbb1c1b8ff service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:37.118244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:37.119165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:37.119446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:37.119722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] PATH_INFO: `/v3/users/8b9d7ba651b2480a9de46952badf6a31` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:37.120892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9d7ba651b2480a9de46952badf6a31)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:37.122866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:37.590854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9d7ba651b2480a9de46952badf6a31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.603586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9d7ba651b2480a9de46952badf6a31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.725417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9d7ba651b2480a9de46952badf6a31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.736633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9d7ba651b2480a9de46952badf6a31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.736633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-435262c7-fb2c-417c-8639-1cef6f9b1be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9d7ba651b2480a9de46952badf6a31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:37.758249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 955/1892] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:37 2022] DELETE /identity/v3/users/8b9d7ba651b2480a9de46952badf6a31 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:37.973464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:38.172143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:38.523787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:38.526070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:38.549985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf1f2-bb4e-427e-9ef9-d84655a21e89 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:38.681982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:38.684053 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:38.686455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:38.687588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] PATH_INFO: `/v3/projects/65d6b49793294b4584ac5b50410fb86a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:38.693017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d6b49793294b4584ac5b50410fb86a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:38.698833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:38.997450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d6b49793294b4584ac5b50410fb86a', 'request_id': 'req-8ff385bf-ca55-49d9-a196-8f049aa294cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:39.004788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d6b49793294b4584ac5b50410fb86a', 'request_id': 'req-8ff385bf-ca55-49d9-a196-8f049aa294cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:39.011258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d6b49793294b4584ac5b50410fb86a', 'request_id': 'req-8ff385bf-ca55-49d9-a196-8f049aa294cf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:39.263371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] The token cache is being invalidate because project 65d6b49793294b4584ac5b50410fb86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:39.267381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:39.267381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ff385bf-ca55-49d9-a196-8f049aa294cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:39.267381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 938/1893] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:38 2022] DELETE /identity/v3/projects/65d6b49793294b4584ac5b50410fb86a => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:39.271246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be46e-026e-41d5-8a51-ce095427fed4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:39.271749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be46e-026e-41d5-8a51-ce095427fed4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:39.271838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be46e-026e-41d5-8a51-ce095427fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:39.292377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8b5be46e-026e-41d5-8a51-ce095427fed4 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:39.293609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8b5be46e-026e-41d5-8a51-ce095427fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:39.366245 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 956/1894] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:39.374338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626026-4270-4d81-9451-e83cb55e8b8a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:39.374751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626026-4270-4d81-9451-e83cb55e8b8a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:39.375233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626026-4270-4d81-9451-e83cb55e8b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:39.403029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-32626026-4270-4d81-9451-e83cb55e8b8a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:39.405412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-32626026-4270-4d81-9451-e83cb55e8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:39.418263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 939/1895] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:39.423162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be46e-026e-41d5-8a51-ce095427fed4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:39.433510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be46e-026e-41d5-8a51-ce095427fed4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:39.440602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:39.442296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:39.442780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:39.443681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:39.444641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:39.445629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:39.447545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:39.465510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 957/1896] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:31:39.472039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626026-4270-4d81-9451-e83cb55e8b8a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:39.481692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626026-4270-4d81-9451-e83cb55e8b8a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:39.486610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:39.487309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:39.487595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:39.487872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:39.488604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:39.491433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:39.712338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 940/1897] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:39 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:39.718073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:39.734846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9fff4-cd4a-4851-b987-5ae3b00e9a8d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:39.886117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:39.886466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:39.886790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:39.887075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:39.887791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:39.892440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:40.157913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 958/1898] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:39 2022] POST /identity/v3/users => generated 287 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:40.160002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:40.182340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22825f1-b75c-497a-a2ef-674d7f67cf80 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:40.210908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:40.210908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:40.210908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:40.210908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:40.211225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:40.211225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:40.268563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 941/1899] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:40.269740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:40.289459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999bea6-e342-4b82-97cd-83b50cc1971f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:40.310368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefbc18-02f7-4d6f-839e-1635c164d86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:40.311118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbc18-02f7-4d6f-839e-1635c164d86f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:40.311416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbc18-02f7-4d6f-839e-1635c164d86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:40.311692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbc18-02f7-4d6f-839e-1635c164d86f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:40.312433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefbc18-02f7-4d6f-839e-1635c164d86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:40.315173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefbc18-02f7-4d6f-839e-1635c164d86f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:40.331361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 959/1900] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:40.335752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:40.351419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4401b-7da7-49ed-89ec-9b5d2deb899a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:40.386578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:40.386578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:40.386578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:40.386578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] PATH_INFO: `/v3/projects/ddffb8e9345449eca9376287293ba606/users/4435851b57bf45d2a9254e194d37a722/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:40.401827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddffb8e9345449eca9376287293ba606, user_id=4435851b57bf45d2a9254e194d37a722, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:40.406247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:40.568810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 942/1901] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:40 2022] PUT /identity/v3/projects/ddffb8e9345449eca9376287293ba606/users/4435851b57bf45d2a9254e194d37a722/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:40.579655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a607670-9c3f-40d2-816e-8a7c961bac3b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:40.579939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a607670-9c3f-40d2-816e-8a7c961bac3b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:40.580232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a607670-9c3f-40d2-816e-8a7c961bac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:40.631985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5a607670-9c3f-40d2-816e-8a7c961bac3b None None] MFA Rules not processed for user `4435851b57bf45d2a9254e194d37a722`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:40.634038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5a607670-9c3f-40d2-816e-8a7c961bac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:40.727157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 960/1902] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:40.733350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:40.851158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd7fb-b457-4e51-a4d8-a86b5dc21f08 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:40.866362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:40.867252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:40.867640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:40.868045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:40.868870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:40.873112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:41.330589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 943/1903] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:40 2022] POST /identity/v3/projects => generated 373 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:41.331221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a607670-9c3f-40d2-816e-8a7c961bac3b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:41.347337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a607670-9c3f-40d2-816e-8a7c961bac3b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:41.450391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:41.455860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:41.456379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:41.456822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:41.457756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:41.461809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:42.641831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 961/1904] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:41 2022] POST /identity/v3/users => generated 293 bytes in 1317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:42.648076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:42.659662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848ead-e461-446f-b899-62c9271ee509 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:42.664633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:42.665421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:42.665727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:42.666012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:42.666800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:42.668396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:42.680140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 944/1905] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:42.693526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:42.704042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dc180-5b61-469d-8e7b-ccd4971b0214 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:42.708646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:42.709539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:42.709824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:42.710105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] PATH_INFO: `/v3/projects/4763179d3bda4c80920c0e580b331ffa/users/eee43f406f2b43e584dc5650789f2eed/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:42.725369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4763179d3bda4c80920c0e580b331ffa, user_id=eee43f406f2b43e584dc5650789f2eed, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:42.728534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:42.879391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 962/1906] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:42 2022] PUT /identity/v3/projects/4763179d3bda4c80920c0e580b331ffa/users/eee43f406f2b43e584dc5650789f2eed/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:42.899734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:42.911907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992775-17f2-42d6-a6a8-8876d4d283bb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:42.932521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:42.977604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392953f-4f9a-4848-a4fc-60bce505b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:42.978292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392953f-4f9a-4848-a4fc-60bce505b2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:42.978583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392953f-4f9a-4848-a4fc-60bce505b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:42.978909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392953f-4f9a-4848-a4fc-60bce505b2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:42.979674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392953f-4f9a-4848-a4fc-60bce505b2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:42.981347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392953f-4f9a-4848-a4fc-60bce505b2d2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:42.993361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 945/1907] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:42.997775 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:43.008517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540850f-0b47-4b09-8720-a3cc06438196 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:43.013329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:43.014221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:43.014519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:43.014825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] PATH_INFO: `/v3/projects/4763179d3bda4c80920c0e580b331ffa/users/eee43f406f2b43e584dc5650789f2eed/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:43.017117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4763179d3bda4c80920c0e580b331ffa, user_id=eee43f406f2b43e584dc5650789f2eed, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:43.019916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:43.034306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 963/1908] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:42 2022] PUT /identity/v3/projects/4763179d3bda4c80920c0e580b331ffa/users/eee43f406f2b43e584dc5650789f2eed/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:43.045748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4ef52-d477-491d-8903-cc065a20da1a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:43.046107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4ef52-d477-491d-8903-cc065a20da1a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:43.046457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4ef52-d477-491d-8903-cc065a20da1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:43.077302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-04a4ef52-d477-491d-8903-cc065a20da1a None None] MFA Rules not processed for user `eee43f406f2b43e584dc5650789f2eed`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:43.079438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-04a4ef52-d477-491d-8903-cc065a20da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:43.224881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 946/1909] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:43.237324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:43.239242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:43.306791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c3a5-8683-48af-a89f-aa7480f1060d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:43.313915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:43.313915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:43.313915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:43.313915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:43.373270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:43.375159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:43.386158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 964/1910] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:31:44.601147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:46.699922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ad59d-9b25-45c6-9161-52d2ea243d44 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:46.700540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ad59d-9b25-45c6-9161-52d2ea243d44 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:46.700540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ad59d-9b25-45c6-9161-52d2ea243d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:46.736695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-821ad59d-9b25-45c6-9161-52d2ea243d44 None None] MFA Rules not processed for user `0cb483ff24aa45cd9ce01152374c9e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:46.738219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-821ad59d-9b25-45c6-9161-52d2ea243d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:46.826489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 947/1911] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:46.831757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:46.833513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:46.913451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53c73-bc35-41fa-a55d-77203e9a1efe service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:46.918062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:46.918828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:46.919119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:46.919396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:46.920091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:46.922009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:47.121943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 965/1912] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:46 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:47.126692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ad59d-9b25-45c6-9161-52d2ea243d44 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:47.137527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ad59d-9b25-45c6-9161-52d2ea243d44 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:47.201486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:47.202160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:47.202443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:47.202760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:47.204312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:47.206840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:47.464205 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 948/1913] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:47 2022] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:47.467350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:47.483462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164726f-e253-4e13-9643-ebcd0a0e1a7f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:47.489844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:47.490705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:47.491010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:47.491320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:47.492189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:47.493911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:47.507363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 966/1914] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:47.511655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:47.526494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55008a4-d492-42dd-8fc4-63b39d349887 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:47.532580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:47.533752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:47.534188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:47.534617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] PATH_INFO: `/v3/projects/688c930255df4ea38661c6b60b433814/users/71f04b7b38234718a39ebd1256df6d3c/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:47.557497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688c930255df4ea38661c6b60b433814, user_id=71f04b7b38234718a39ebd1256df6d3c, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:47.577256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:47.749642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 949/1915] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:47 2022] PUT /identity/v3/projects/688c930255df4ea38661c6b60b433814/users/71f04b7b38234718a39ebd1256df6d3c/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:47.754484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:47.765362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1068-bbfd-4362-b584-53dab5796f1b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:47.834624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:47.835640 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:47.836002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:47.836367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:47.837494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:47.839593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:47.851706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 967/1916] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:47.856171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:47.868259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1939f-f30b-48cb-8df3-ea18e8e89f33 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:47.873097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43d12f-91de-4f55-a61c-d37e35b1185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:47.883315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43d12f-91de-4f55-a61c-d37e35b1185f admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:47.883315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43d12f-91de-4f55-a61c-d37e35b1185f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:47.883315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43d12f-91de-4f55-a61c-d37e35b1185f admin admin] PATH_INFO: `/v3/projects/688c930255df4ea38661c6b60b433814/users/71f04b7b38234718a39ebd1256df6d3c/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:47.883315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43d12f-91de-4f55-a61c-d37e35b1185f admin admin] RBAC: Authorizing `identity:create_grant(project_id=688c930255df4ea38661c6b60b433814, user_id=71f04b7b38234718a39ebd1256df6d3c, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:47.883315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43d12f-91de-4f55-a61c-d37e35b1185f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:47.899309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 950/1917] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:47 2022] PUT /identity/v3/projects/688c930255df4ea38661c6b60b433814/users/71f04b7b38234718a39ebd1256df6d3c/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:48.324464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:48.334523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a671-62e1-4c03-a6f7-4d4f3454099c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:48.396723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:48.397666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:48.398073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:48.398361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] PATH_INFO: `/v3/users/4435851b57bf45d2a9254e194d37a722` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:48.399767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4435851b57bf45d2a9254e194d37a722)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:48.402436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:48.811886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4435851b57bf45d2a9254e194d37a722'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:48.840211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4435851b57bf45d2a9254e194d37a722'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:49.120459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4435851b57bf45d2a9254e194d37a722'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:49.121201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4435851b57bf45d2a9254e194d37a722'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:49.121924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4435851b57bf45d2a9254e194d37a722'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:49.149777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 968/1918] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:48 2022] DELETE /identity/v3/users/4435851b57bf45d2a9254e194d37a722 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:49.152158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:49.152677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:49.152769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:49.171686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:49.173182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:49.257417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 951/1919] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:49.269201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:49.270956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:49.353569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb21e-d57e-4932-8c97-d0c7316e4ffd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:49.361406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:49.363303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:49.363791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:49.364129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:49.390314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:49.393868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:49.410425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 969/1920] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:50.601918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:50.604215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:50.621137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419253-cf72-42b6-b3d0-a0a4448230b4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:50.637320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:50.638432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:50.638855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:50.685618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] PATH_INFO: `/v3/projects/ddffb8e9345449eca9376287293ba606` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:50.685618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddffb8e9345449eca9376287293ba606)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:50.685618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:50.964110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddffb8e9345449eca9376287293ba606', 'request_id': 'req-66084a06-160e-4708-b399-824bf97ebae0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:50.970563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddffb8e9345449eca9376287293ba606', 'request_id': 'req-66084a06-160e-4708-b399-824bf97ebae0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.005668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddffb8e9345449eca9376287293ba606', 'request_id': 'req-66084a06-160e-4708-b399-824bf97ebae0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.157464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] The token cache is being invalidate because project ddffb8e9345449eca9376287293ba606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:51.159419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.159419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.160991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 952/1921] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:50 2022] DELETE /identity/v3/projects/ddffb8e9345449eca9376287293ba606 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:51.165123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:51.177951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610483-4348-42da-8458-805e2da9b95b service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:51.269093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:51.306469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:51.307601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:51.307947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:51.308291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] PATH_INFO: `/v3/users/eee43f406f2b43e584dc5650789f2eed` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:51.309578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee43f406f2b43e584dc5650789f2eed)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:51.311774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:51.505504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee43f406f2b43e584dc5650789f2eed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.528643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee43f406f2b43e584dc5650789f2eed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.624899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee43f406f2b43e584dc5650789f2eed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.626406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee43f406f2b43e584dc5650789f2eed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.627639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb8219fa-2973-4ede-9b18-5b8a6c6372f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee43f406f2b43e584dc5650789f2eed'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:51.648975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 970/1922] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:51 2022] DELETE /identity/v3/users/eee43f406f2b43e584dc5650789f2eed => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:52.331736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:52.573118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:52.574783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:52.593255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084a06-160e-4708-b399-824bf97ebae0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:52.653335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:52.654215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:52.654498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:52.654878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] PATH_INFO: `/v3/projects/4763179d3bda4c80920c0e580b331ffa` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:52.657034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4763179d3bda4c80920c0e580b331ffa)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:52.658832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:52.835081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4763179d3bda4c80920c0e580b331ffa', 'request_id': 'req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:52.840953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4763179d3bda4c80920c0e580b331ffa', 'request_id': 'req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:52.849385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4763179d3bda4c80920c0e580b331ffa', 'request_id': 'req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:52.939533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] The token cache is being invalidate because project 4763179d3bda4c80920c0e580b331ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:52.940092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:52.941161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85df42ba-0b4f-40ec-b0ae-443d7b2b5724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:52.946721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 953/1923] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:52 2022] DELETE /identity/v3/projects/4763179d3bda4c80920c0e580b331ffa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:52.948030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb7740-dee0-408c-b434-7d539360bfa9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:52.948513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb7740-dee0-408c-b434-7d539360bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:52.948605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb7740-dee0-408c-b434-7d539360bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:52.972474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-36eb7740-dee0-408c-b434-7d539360bfa9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:52.973904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-36eb7740-dee0-408c-b434-7d539360bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:53.099532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 971/1924] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:53.108307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3af663-3de1-45f6-b8f6-7bdb7e396f82 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.108603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3af663-3de1-45f6-b8f6-7bdb7e396f82 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.109061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3af663-3de1-45f6-b8f6-7bdb7e396f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.132893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-da3af663-3de1-45f6-b8f6-7bdb7e396f82 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:53.134125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-da3af663-3de1-45f6-b8f6-7bdb7e396f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:53.143767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 954/1925] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:53.147723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb7740-dee0-408c-b434-7d539360bfa9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:53.159064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb7740-dee0-408c-b434-7d539360bfa9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:53.172332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:53.173107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.173465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.173899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.175366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:53.175689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:53.177521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:53.195238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 972/1926] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:31:53.196996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3af663-3de1-45f6-b8f6-7bdb7e396f82 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:53.208931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3af663-3de1-45f6-b8f6-7bdb7e396f82 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:53.217410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:53.219215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.219685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.220192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.221606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:53.224091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:53.389056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 955/1927] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:53 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:53.394237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:53.412061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45532b83-cb4c-4808-9c81-8e8848a18005 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:53.506379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:53.507303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.507694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.508082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.508886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:53.511630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:53.717563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 973/1928] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:53 2022] POST /identity/v3/users => generated 286 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:53.717853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:53.728975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac29e1-7136-4e80-8fe8-c3d8c3ccc88f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:53.734400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:53.735868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.736269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.736621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.737373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:53.739102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:53.750997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 956/1929] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:31:53.758886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:53.772690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7cc7c-a038-419c-b37d-5e90fd8b2bb7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:53.778811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67108699-d55a-4a7b-8334-66ca2f946f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:53.779501 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67108699-d55a-4a7b-8334-66ca2f946f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.779789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67108699-d55a-4a7b-8334-66ca2f946f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.780322 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67108699-d55a-4a7b-8334-66ca2f946f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.781478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67108699-d55a-4a7b-8334-66ca2f946f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:53.783206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67108699-d55a-4a7b-8334-66ca2f946f06 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:53.794978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 974/1930] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:53.799826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:53.812395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:53.812592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3176d0-ae41-45cb-a21e-94a50bc48169 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:53.817748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:53.818839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.819123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.819721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] PATH_INFO: `/v3/projects/09e8befdb4d44ffab79b3c1d1595bb80/users/930438c2f76746d1bfb59d466f9f6864/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.836974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e8befdb4d44ffab79b3c1d1595bb80, user_id=930438c2f76746d1bfb59d466f9f6864, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:53.840124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:53.949591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 957/1931] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:53 2022] PUT /identity/v3/projects/09e8befdb4d44ffab79b3c1d1595bb80/users/930438c2f76746d1bfb59d466f9f6864/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:53.960339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4e7-77d9-40a4-ba8e-935f83f6767a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:53.960845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4e7-77d9-40a4-ba8e-935f83f6767a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:53.960937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4e7-77d9-40a4-ba8e-935f83f6767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:53.988691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-78b3d4e7-77d9-40a4-ba8e-935f83f6767a None None] MFA Rules not processed for user `930438c2f76746d1bfb59d466f9f6864`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:53.989893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-78b3d4e7-77d9-40a4-ba8e-935f83f6767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:54.093474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 975/1932] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:54.101079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:54.103138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:54.237899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d70e-35b1-4541-a54a-75ac66276ad7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:54.251679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61100d5-cff7-4703-8964-2971d1a404a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:54.252502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61100d5-cff7-4703-8964-2971d1a404a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:54.252946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61100d5-cff7-4703-8964-2971d1a404a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:54.253522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61100d5-cff7-4703-8964-2971d1a404a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:54.277009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61100d5-cff7-4703-8964-2971d1a404a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:54.279849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61100d5-cff7-4703-8964-2971d1a404a0 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:54.322531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 958/1933] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:54.371679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d4e7-77d9-40a4-ba8e-935f83f6767a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:54.521086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d4e7-77d9-40a4-ba8e-935f83f6767a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:54.531619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:54.532806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:54.533236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:54.533660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] PATH_INFO: `/v3/users/930438c2f76746d1bfb59d466f9f6864` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:54.538484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=930438c2f76746d1bfb59d466f9f6864)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:54.543802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:54.904331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930438c2f76746d1bfb59d466f9f6864'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:54.919598 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930438c2f76746d1bfb59d466f9f6864'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:55.139285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930438c2f76746d1bfb59d466f9f6864'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:55.144702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930438c2f76746d1bfb59d466f9f6864'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:55.146901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930438c2f76746d1bfb59d466f9f6864'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:55.176929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 976/1934] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:31:54 2022] DELETE /identity/v3/users/930438c2f76746d1bfb59d466f9f6864 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:55.182043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86bd6c-c956-46fc-a83e-32f0052ed52d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:55.185354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86bd6c-c956-46fc-a83e-32f0052ed52d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:55.185354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86bd6c-c956-46fc-a83e-32f0052ed52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:55.213658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1d86bd6c-c956-46fc-a83e-32f0052ed52d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:55.216420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1d86bd6c-c956-46fc-a83e-32f0052ed52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:55.301583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 959/1935] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:55.322205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:55.324308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:55.404164 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9918a7-a0aa-4e70-ae70-f38dfffdb8ea admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:55.409557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:55.410947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:55.411415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:55.412123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:55.422984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:55.426388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:55.440606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 977/1936] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:55.486396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:55.709457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:56.418187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:56.844569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:56.845044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:56.845412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:56.861226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:56.862739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:56.882168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddff3-538c-4ec3-94c4-2d6a1c8fcd40 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:56.886935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] MFA Rules not processed for user `71f04b7b38234718a39ebd1256df6d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:56.886935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:56.888787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:56.890427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:56.891480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:56.891932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] PATH_INFO: `/v3/projects/09e8befdb4d44ffab79b3c1d1595bb80` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:56.894857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e8befdb4d44ffab79b3c1d1595bb80)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:56.897928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:57.018999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 960/1937] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:57.034107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:57.037952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:57.050735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e8befdb4d44ffab79b3c1d1595bb80', 'request_id': 'req-a044ac8a-839a-4f59-bb5d-68358da06b1c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:57.133104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a0c-8259-40f0-92ad-7355524fbd74 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:57.156143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e8befdb4d44ffab79b3c1d1595bb80', 'request_id': 'req-a044ac8a-839a-4f59-bb5d-68358da06b1c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:57.163794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e8befdb4d44ffab79b3c1d1595bb80', 'request_id': 'req-a044ac8a-839a-4f59-bb5d-68358da06b1c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:57.177545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] The token cache is being invalidate because project 09e8befdb4d44ffab79b3c1d1595bb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:31:57.178277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:57.180807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a044ac8a-839a-4f59-bb5d-68358da06b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:31:57.188493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 978/1938] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:31:56 2022] DELETE /identity/v3/projects/09e8befdb4d44ffab79b3c1d1595bb80 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:31:57.193484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf675ef-1527-4a83-a157-753a44c7812c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.193783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf675ef-1527-4a83-a157-753a44c7812c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.194266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf675ef-1527-4a83-a157-753a44c7812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.207060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:57.207988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.208424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.208854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.211168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:57.213948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2bf675ef-1527-4a83-a157-753a44c7812c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:57.215271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2bf675ef-1527-4a83-a157-753a44c7812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:57.311825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:57.317505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:57.346663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 979/1939] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:57.347317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 961/1940] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:31:57.356193 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23e405-0e85-4ef8-bcba-08f0e8f008e2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.360556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23e405-0e85-4ef8-bcba-08f0e8f008e2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.364503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23e405-0e85-4ef8-bcba-08f0e8f008e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.388367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9f23e405-0e85-4ef8-bcba-08f0e8f008e2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:57.389796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9f23e405-0e85-4ef8-bcba-08f0e8f008e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:57.400392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 980/1941] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:57.404694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:57.418940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e1a0-29a7-498f-a747-32e5e1b1ff70 service glance] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:57.426309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:57.427107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.427403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.427695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.428588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:31:57.428811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:57.430440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:57.452544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 962/1942] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:31:57.454319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23e405-0e85-4ef8-bcba-08f0e8f008e2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:57.478232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23e405-0e85-4ef8-bcba-08f0e8f008e2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:57.485722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20301c15-3ffe-4af6-afb8-b418a1f2400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:57.487159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301c15-3ffe-4af6-afb8-b418a1f2400d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.487620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301c15-3ffe-4af6-afb8-b418a1f2400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.488040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301c15-3ffe-4af6-afb8-b418a1f2400d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.489263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20301c15-3ffe-4af6-afb8-b418a1f2400d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:57.491705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20301c15-3ffe-4af6-afb8-b418a1f2400d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:57.623371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 981/1943] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:31:57 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:57.627296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:57.639452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064318-f388-46bc-bcbf-ed79bf9e6dc8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:57.711578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:57.712365 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.712691 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.713007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.713801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:57.716206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:57.721042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.721358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.721660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.745383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:57.746986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:57.809516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 982/1944] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:31:57.833009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:57.838929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:57.915244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 963/1945] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:31:57 2022] POST /identity/v3/users => generated 287 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:31:57.916264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:57.928764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:57.929688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5965e2-ffe8-4909-99c4-f4cff4d060f5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:57.934524 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:57.935441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.935654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.935941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.936755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b002e-e835-4d0e-bb07-98a86e741cd3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:57.936870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:57.939381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:57.947250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:57.947928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.948218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.948507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.959536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:57.960298 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 964/1946] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:57.962168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:57.964151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:57.977353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 983/1947] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:31:57.978917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279857d-6631-406f-8b24-f43f53fa588b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:57.984201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5258-21d5-40bc-bfdb-76810c62f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:57.985046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5258-21d5-40bc-bfdb-76810c62f10a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:57.985342 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5258-21d5-40bc-bfdb-76810c62f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:57.985620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5258-21d5-40bc-bfdb-76810c62f10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:57.986355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f5258-21d5-40bc-bfdb-76810c62f10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:57.988168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f5258-21d5-40bc-bfdb-76810c62f10a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:58.004477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 965/1948] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:31:58.005411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:58.035449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944e9eb-2884-4f6b-a654-dd975c5616a4 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:58.047572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:58.051836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:58.051836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:58.051836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] PATH_INFO: `/v3/projects/08e16e9fe27747cda2686971a5dc59a2/users/e7ebbe1627704b0a84992052805e3f84/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:58.111432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e16e9fe27747cda2686971a5dc59a2, user_id=e7ebbe1627704b0a84992052805e3f84, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:58.124713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:58.254694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 984/1949] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:31:58 2022] PUT /identity/v3/projects/08e16e9fe27747cda2686971a5dc59a2/users/e7ebbe1627704b0a84992052805e3f84/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:31:58.264825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad68742-4561-4372-bcc9-68dfeb5cbcac None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:58.265565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad68742-4561-4372-bcc9-68dfeb5cbcac None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:58.266609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad68742-4561-4372-bcc9-68dfeb5cbcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:58.326853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cad68742-4561-4372-bcc9-68dfeb5cbcac None None] MFA Rules not processed for user `e7ebbe1627704b0a84992052805e3f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:31:58.328688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cad68742-4561-4372-bcc9-68dfeb5cbcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:58.538081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 966/1950] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:31:58.558022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:31:58.560383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:31:58.596125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:58.701082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef643cb-8fd9-48c6-bb21-19eff6606d15 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:31:58.707721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:31:58.708519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:31:58.708908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:31:58.709289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:31:58.736976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:31:58.738693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:31:58.766315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 985/1951] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:00.876040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:01.274739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:01.512448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:01.533229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:02.761471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891afd2-2cad-4ada-84f2-94a2b397df79 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:02.762427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891afd2-2cad-4ada-84f2-94a2b397df79 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:02.763002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891afd2-2cad-4ada-84f2-94a2b397df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:02.789329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6891afd2-2cad-4ada-84f2-94a2b397df79 None None] MFA Rules not processed for user `e7ebbe1627704b0a84992052805e3f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:02.797555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6891afd2-2cad-4ada-84f2-94a2b397df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:02.807264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 967/1952] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:02.819822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:03.440321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:03.443047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:03.690233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3509d7-9870-476c-892f-9996669c12af service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:03.700502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:03.701810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:03.702107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:03.702390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] PATH_INFO: `/v3/users/aa2f74ac39ff45bf8f2d0c5e982a6afe` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:03.714726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2f74ac39ff45bf8f2d0c5e982a6afe)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:03.714726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:04.051982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2f74ac39ff45bf8f2d0c5e982a6afe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:04.101709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2f74ac39ff45bf8f2d0c5e982a6afe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:04.200481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2f74ac39ff45bf8f2d0c5e982a6afe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:04.204288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2f74ac39ff45bf8f2d0c5e982a6afe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:04.204652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2f74ac39ff45bf8f2d0c5e982a6afe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:04.233370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 986/1953] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:32:03 2022] DELETE /identity/v3/users/aa2f74ac39ff45bf8f2d0c5e982a6afe => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:32:04.236361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:04.236891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:04.236891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:04.283511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:04.287119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:04.466702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 968/1954] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:04.475878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:04.482236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:04.513524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:04.579505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15d0a-f81c-4d25-a083-cd62e66f77ae admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:04.583806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0dfe8-469a-49d1-825b-d46f3285a9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:04.584503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0dfe8-469a-49d1-825b-d46f3285a9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:04.584824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0dfe8-469a-49d1-825b-d46f3285a9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:04.585569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0dfe8-469a-49d1-825b-d46f3285a9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:04.607418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0dfe8-469a-49d1-825b-d46f3285a9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:04.609950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0dfe8-469a-49d1-825b-d46f3285a9ff service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:04.627403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 987/1955] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:05.390519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:05.394838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:05.413585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68527b-9bff-44ee-a7f5-41b7536bfe1f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:05.421341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:05.421341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:05.440853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:05.441537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] PATH_INFO: `/v3/projects/8ffb70aba4ce4b0fb357069e21e179db` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:05.449447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffb70aba4ce4b0fb357069e21e179db)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:05.451728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:05.693920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffb70aba4ce4b0fb357069e21e179db', 'request_id': 'req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:05.700034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffb70aba4ce4b0fb357069e21e179db', 'request_id': 'req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:05.707279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffb70aba4ce4b0fb357069e21e179db', 'request_id': 'req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:05.840531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] The token cache is being invalidate because project 8ffb70aba4ce4b0fb357069e21e179db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:32:05.840904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:05.841470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e0e5c2a-6236-4ce1-a3df-0ed77dff875b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:05.843108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 969/1956] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:32:05 2022] DELETE /identity/v3/projects/8ffb70aba4ce4b0fb357069e21e179db => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:05.849037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4ab07-32f2-42dc-aa7b-6dd7694bb1ba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:05.849600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4ab07-32f2-42dc-aa7b-6dd7694bb1ba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:05.849678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4ab07-32f2-42dc-aa7b-6dd7694bb1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:05.872253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-96d4ab07-32f2-42dc-aa7b-6dd7694bb1ba None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:05.873518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-96d4ab07-32f2-42dc-aa7b-6dd7694bb1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:05.971802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 988/1957] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:05.983407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac402b9-8268-44c1-8138-b9c4e154e073 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:05.983778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac402b9-8268-44c1-8138-b9c4e154e073 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:05.983982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac402b9-8268-44c1-8138-b9c4e154e073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.009199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bac402b9-8268-44c1-8138-b9c4e154e073 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:06.010793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bac402b9-8268-44c1-8138-b9c4e154e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:06.021929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 970/1958] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:06.026190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4ab07-32f2-42dc-aa7b-6dd7694bb1ba None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:06.047014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4ab07-32f2-42dc-aa7b-6dd7694bb1ba None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:06.052614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:06.053196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:06.053624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:06.053921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.054787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:32:06.055107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:06.056726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:06.072609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 989/1959] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:32:06.078323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac402b9-8268-44c1-8138-b9c4e154e073 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:06.092872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac402b9-8268-44c1-8138-b9c4e154e073 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:06.098929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:06.099773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:06.100134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:06.100492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.101410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:06.103688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:06.241092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 971/1960] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:32:06 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:06.245171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:06.265086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02251-011b-4af4-af74-5e1f4f38580a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:06.364551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:06.365266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:06.365550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:06.365850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.366564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:06.368577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:06.512628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 990/1961] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:32:06 2022] POST /identity/v3/users => generated 282 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:06.514430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:06.528771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f283b-955d-401d-9f01-7123a0ddded1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:06.534526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:06.535233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:06.535518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:06.535815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.537448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:06.543857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:06.572140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 972/1962] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:06.575867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:06.591557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cbe95-54cc-4722-8d48-fa51975e5e0e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:06.605463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791829c-ad71-4ebf-812b-da89b70dce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:06.605463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791829c-ad71-4ebf-812b-da89b70dce95 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:06.605463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791829c-ad71-4ebf-812b-da89b70dce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:06.605463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791829c-ad71-4ebf-812b-da89b70dce95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.606173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791829c-ad71-4ebf-812b-da89b70dce95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:06.609084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791829c-ad71-4ebf-812b-da89b70dce95 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:06.632662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 991/1963] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:06.636884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:06.649847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eb7f0-ee3a-44c7-8cef-a24e21026ac6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:06.658427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:06.659531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:06.660078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:06.660462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] PATH_INFO: `/v3/projects/b859f3092e3b403dad1b3a8062f399f5/users/4426d4de2f434644890a7bec135c1c0e/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.689221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b859f3092e3b403dad1b3a8062f399f5, user_id=4426d4de2f434644890a7bec135c1c0e, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:06.694700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:06.781663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:06.789093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 973/1964] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:32:06 2022] PUT /identity/v3/projects/b859f3092e3b403dad1b3a8062f399f5/users/4426d4de2f434644890a7bec135c1c0e/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:06.800222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd9e5-03f2-4886-bd96-c5320cc8affb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:06.800543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd9e5-03f2-4886-bd96-c5320cc8affb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:06.800803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd9e5-03f2-4886-bd96-c5320cc8affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:06.841905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e64dd9e5-03f2-4886-bd96-c5320cc8affb None None] MFA Rules not processed for user `4426d4de2f434644890a7bec135c1c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:06.843177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e64dd9e5-03f2-4886-bd96-c5320cc8affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:06.870896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:06.939869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 992/1965] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:06.949611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:06.951452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:07.023736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d9a3-5d1c-4979-b73d-e575c629784a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:07.029299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e661d47-f37d-48e7-921b-22b5f16ff577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:07.029965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e661d47-f37d-48e7-921b-22b5f16ff577 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:07.030506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e661d47-f37d-48e7-921b-22b5f16ff577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:07.030820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e661d47-f37d-48e7-921b-22b5f16ff577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:07.040402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e661d47-f37d-48e7-921b-22b5f16ff577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:07.041847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e661d47-f37d-48e7-921b-22b5f16ff577 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:07.062095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 974/1966] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:14.457529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711b7d-ba53-4997-bd94-f3f5bb69c15d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:14.458053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711b7d-ba53-4997-bd94-f3f5bb69c15d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:14.458161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711b7d-ba53-4997-bd94-f3f5bb69c15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:14.487142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-47711b7d-ba53-4997-bd94-f3f5bb69c15d None None] MFA Rules not processed for user `0cb483ff24aa45cd9ce01152374c9e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:14.487142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-47711b7d-ba53-4997-bd94-f3f5bb69c15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:14.567176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 993/1967] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:17.471269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=27 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:21.909283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143137b2-db1b-4fd2-9cf2-2715996a041c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:21.909909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143137b2-db1b-4fd2-9cf2-2715996a041c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:21.909909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143137b2-db1b-4fd2-9cf2-2715996a041c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:21.911499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 975/1968] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:32:21.950625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:21.951182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:21.951182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:21.973489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:21.974745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:22.131489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 994/1969] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:22.143837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143137b2-db1b-4fd2-9cf2-2715996a041c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:22.145717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-143137b2-db1b-4fd2-9cf2-2715996a041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:22.164921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143137b2-db1b-4fd2-9cf2-2715996a041c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:22.173358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99155-14ad-44a9-af94-082a87184228 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:22.174036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99155-14ad-44a9-af94-082a87184228 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:22.174324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99155-14ad-44a9-af94-082a87184228 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:22.174794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99155-14ad-44a9-af94-082a87184228 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:22.226400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99155-14ad-44a9-af94-082a87184228 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:22.226400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99155-14ad-44a9-af94-082a87184228 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:22.226400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 976/1970] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:22.292531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:22.294099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:22.396591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:22.401660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2267d-afe2-4956-9024-799da041bf17 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:22.408148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:22.409081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:22.409415 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:22.409944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] PATH_INFO: `/v3/users/cc17873bfe0542feae57ffe881cc1598` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:22.411323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc17873bfe0542feae57ffe881cc1598)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:22.413553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:22.848686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc17873bfe0542feae57ffe881cc1598'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:22.861334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc17873bfe0542feae57ffe881cc1598'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:22.982918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc17873bfe0542feae57ffe881cc1598'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:22.983736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc17873bfe0542feae57ffe881cc1598'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:22.984432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc17873bfe0542feae57ffe881cc1598'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:22.998915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 995/1971] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:32:22 2022] DELETE /identity/v3/users/cc17873bfe0542feae57ffe881cc1598 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:23.613092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:23.613576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:23.613725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:23.631798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:23.633001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:23.690144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 977/1972] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:23.715937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:23.715937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:23.716182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:23.716182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:23.785265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee199ac-4f05-4415-a491-a9cce7894a22 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:23.801358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:23.802856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:23.802856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:23.802856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] PATH_INFO: `/v3/projects/593938010dbb4ef49efa9ab5f74c1ac2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:23.805255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] RBAC: Authorizing `identity:delete_project(project_id=593938010dbb4ef49efa9ab5f74c1ac2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:23.807233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:23.851262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5179cb5-caba-422b-9082-15e3bed43186 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:23.860146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350e24-f834-4892-86db-bd935cf89709 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:23.860827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350e24-f834-4892-86db-bd935cf89709 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:23.861113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350e24-f834-4892-86db-bd935cf89709 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:23.861392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350e24-f834-4892-86db-bd935cf89709 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:23.872223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350e24-f834-4892-86db-bd935cf89709 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:23.873850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350e24-f834-4892-86db-bd935cf89709 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:23.883989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 978/1973] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:32:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:32:24.099273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593938010dbb4ef49efa9ab5f74c1ac2', 'request_id': 'req-4470bff1-c80c-4937-b723-73d247bf515b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:24.423599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593938010dbb4ef49efa9ab5f74c1ac2', 'request_id': 'req-4470bff1-c80c-4937-b723-73d247bf515b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:24.438576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593938010dbb4ef49efa9ab5f74c1ac2', 'request_id': 'req-4470bff1-c80c-4937-b723-73d247bf515b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:24.465450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] The token cache is being invalidate because project 593938010dbb4ef49efa9ab5f74c1ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:32:24.465745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:24.470195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4470bff1-c80c-4937-b723-73d247bf515b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:24.476973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6647b-f1bb-4375-8735-b8d1bf6aa0d2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:24.477318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6647b-f1bb-4375-8735-b8d1bf6aa0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:24.477665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6647b-f1bb-4375-8735-b8d1bf6aa0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:24.479198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 996/1974] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:32:23 2022] DELETE /identity/v3/projects/593938010dbb4ef49efa9ab5f74c1ac2 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:24.507962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ada6647b-f1bb-4375-8735-b8d1bf6aa0d2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:24.509192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ada6647b-f1bb-4375-8735-b8d1bf6aa0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:24.625710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 979/1975] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:24.628820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1277-a1e5-42f9-beb5-71d0dda6ff50 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:24.631038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1277-a1e5-42f9-beb5-71d0dda6ff50 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:24.631477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1277-a1e5-42f9-beb5-71d0dda6ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:24.648672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:24.655170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-79db1277-a1e5-42f9-beb5-71d0dda6ff50 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:24.657490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-79db1277-a1e5-42f9-beb5-71d0dda6ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:24.670572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 997/1976] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:24.672596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6647b-f1bb-4375-8735-b8d1bf6aa0d2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:24.683876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6647b-f1bb-4375-8735-b8d1bf6aa0d2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:24.690435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:24.691496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:24.692000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:24.692452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:24.693394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:32:24.693849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:24.695731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:24.713035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 980/1977] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:32:24.714305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db1277-a1e5-42f9-beb5-71d0dda6ff50 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:24.743535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db1277-a1e5-42f9-beb5-71d0dda6ff50 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:24.759876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:24.759876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:24.759876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:24.759876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:24.760766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:24.761273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:25.193803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 998/1978] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:32:24 2022] POST /identity/v3/projects => generated 357 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:32:25.198626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:25.221316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af22648-a19d-470d-8b2c-19d2542fda7c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:25.234721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:25.348327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:25.349955 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:25.350271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:25.350614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:25.351430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:25.354086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:25.523422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 981/1979] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:32:25 2022] POST /identity/v3/users => generated 279 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:25.524728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:25.536014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d0ea-2dd8-4086-9d2d-71e05a143cac admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:25.541015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:25.542321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:25.542575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:25.542912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:25.543709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:25.545534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:25.558478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 999/1980] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:32:25.562435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:25.572950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900c91-ffb3-41bf-a48e-b6164c406a0f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:25.600564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a9fb6-8435-4d76-9682-59d178009752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:25.601047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9fb6-8435-4d76-9682-59d178009752 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:25.601336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9fb6-8435-4d76-9682-59d178009752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:25.601646 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a9fb6-8435-4d76-9682-59d178009752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:25.607119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a9fb6-8435-4d76-9682-59d178009752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:25.608891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a9fb6-8435-4d76-9682-59d178009752 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:25.636109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 982/1981] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:32:25.641353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:25.670301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1be4c-4d74-428d-9abc-4cfa5e779764 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:25.695686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:25.696616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:25.696962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:25.697324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] PATH_INFO: `/v3/projects/c6d463d0731b487990c4c80bffb7ac11/users/3fdcd945b7ca496cbfce7090652b49bf/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:25.762932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d463d0731b487990c4c80bffb7ac11, user_id=3fdcd945b7ca496cbfce7090652b49bf, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:25.766395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:25.893063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1000/1982] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:32:25 2022] PUT /identity/v3/projects/c6d463d0731b487990c4c80bffb7ac11/users/3fdcd945b7ca496cbfce7090652b49bf/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:25.910079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e069f4-547a-40f3-b771-5aa0372d0c5f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:25.910590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e069f4-547a-40f3-b771-5aa0372d0c5f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:25.911400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e069f4-547a-40f3-b771-5aa0372d0c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:25.949192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a2e069f4-547a-40f3-b771-5aa0372d0c5f None None] MFA Rules not processed for user `3fdcd945b7ca496cbfce7090652b49bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:25.950705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a2e069f4-547a-40f3-b771-5aa0372d0c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:26.085707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 983/1983] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:32:26.091052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:26.205533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d970-94bc-47f6-bff2-d21b98a7dbab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:26.210875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:26.211565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:26.211857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:26.212142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:26.212976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:26.214984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:26.368129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1001/1984] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:32:26 2022] POST /identity/v3/projects => generated 357 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:26.372313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e069f4-547a-40f3-b771-5aa0372d0c5f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:26.383437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e069f4-547a-40f3-b771-5aa0372d0c5f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:26.442582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:26.443329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:26.443616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:26.443896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:26.444647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:26.446590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:26.613489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 984/1985] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:32:26 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:26.616996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:26.627459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcdaf4-cafa-49e8-9683-50e6b857fb0e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:26.632090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:26.632814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:26.633029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:26.633303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:26.634041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:26.635688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:26.647814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1002/1986] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:26.652218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:26.664756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd27e81-23e7-4f1b-9dc0-daa45c96ce9e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:26.669609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:26.670516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:26.670983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:26.671315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] PATH_INFO: `/v3/projects/3bbe78d9de364d46aa496dd20c7e2ba1/users/a8e9c050426e4a53bd8a96e21144c697/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:26.673891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:26.687930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbe78d9de364d46aa496dd20c7e2ba1, user_id=a8e9c050426e4a53bd8a96e21144c697, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:26.690535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:26.864088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 985/1987] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:32:26 2022] PUT /identity/v3/projects/3bbe78d9de364d46aa496dd20c7e2ba1/users/a8e9c050426e4a53bd8a96e21144c697/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:26.868260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:26.878306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd27d2-6eaa-44bf-a3aa-872175e040a9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:26.973048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0f94-9b14-48bd-bca3-6c953868eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:26.973280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0f94-9b14-48bd-bca3-6c953868eecb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:26.973653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0f94-9b14-48bd-bca3-6c953868eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:26.974034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0f94-9b14-48bd-bca3-6c953868eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:26.974920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0f94-9b14-48bd-bca3-6c953868eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:26.976631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0f94-9b14-48bd-bca3-6c953868eecb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:26.988320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1003/1988] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:26.992604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:27.005188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795ae7-d5da-4aea-adfd-b0b410198c8e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:27.010049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:27.011051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:27.011358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:27.011658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] PATH_INFO: `/v3/projects/3bbe78d9de364d46aa496dd20c7e2ba1/users/a8e9c050426e4a53bd8a96e21144c697/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:27.013842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbe78d9de364d46aa496dd20c7e2ba1, user_id=a8e9c050426e4a53bd8a96e21144c697, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:27.018355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:27.052500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 986/1989] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:32:26 2022] PUT /identity/v3/projects/3bbe78d9de364d46aa496dd20c7e2ba1/users/a8e9c050426e4a53bd8a96e21144c697/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:27.067347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:27.067347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:27.067347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:27.101144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] MFA Rules not processed for user `a8e9c050426e4a53bd8a96e21144c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:27.102508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:27.184562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1004/1990] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:27.194627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:27.196583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:27.278128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506b959-8480-4dad-9793-7334258b32c6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:27.283366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:27.284157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:27.284567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:27.285770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:27.295568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:27.298084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:27.309331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 987/1991] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:27 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:27.681713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:27.683199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:27.695738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd4d9a-ce45-41b3-aaff-4d64a0fe1ee7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:27.699641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb512b-5adb-4482-99ee-9bae335ec235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:27.700374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb512b-5adb-4482-99ee-9bae335ec235 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:27.700731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb512b-5adb-4482-99ee-9bae335ec235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:27.701091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb512b-5adb-4482-99ee-9bae335ec235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:27.769155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb512b-5adb-4482-99ee-9bae335ec235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:27.770777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb512b-5adb-4482-99ee-9bae335ec235 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:27.783704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1005/1992] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:27 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:30.879644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:41.049935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=38,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:44.010899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=56 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:54.473212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:54.548064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0e41-6a0c-4f8a-97a6-f628441e766f service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:54.552842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:54.553730 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:54.554021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:54.554298 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] PATH_INFO: `/v3/users/3fdcd945b7ca496cbfce7090652b49bf` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:54.555541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fdcd945b7ca496cbfce7090652b49bf)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:54.557477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:54.893395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fdcd945b7ca496cbfce7090652b49bf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:54.909416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fdcd945b7ca496cbfce7090652b49bf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:54.910151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fdcd945b7ca496cbfce7090652b49bf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:55.102667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fdcd945b7ca496cbfce7090652b49bf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:55.103372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fdcd945b7ca496cbfce7090652b49bf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:55.117431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 988/1993] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:32:54 2022] DELETE /identity/v3/users/3fdcd945b7ca496cbfce7090652b49bf => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:55.121842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:55.122346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:55.122457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:55.151054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:55.152329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:55.215728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1006/1994] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:55.225570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:55.227264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:55.294000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6b9cd-aa7e-47ea-b83e-3172dfdee314 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:55.297834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:55.298579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:55.298967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:55.299387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:55.309774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:55.311419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:55.323993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 989/1995] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:32:56.199276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:56.201978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:56.216422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce678dd-df24-4ed9-9d26-d937013490a0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:56.223968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:56.225159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:56.225662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:56.226630 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] PATH_INFO: `/v3/projects/c6d463d0731b487990c4c80bffb7ac11` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:56.228523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d463d0731b487990c4c80bffb7ac11)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:56.231083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:56.382362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d463d0731b487990c4c80bffb7ac11', 'request_id': 'req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:56.513224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d463d0731b487990c4c80bffb7ac11', 'request_id': 'req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:56.523100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d463d0731b487990c4c80bffb7ac11', 'request_id': 'req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:56.536204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] The token cache is being invalidate because project c6d463d0731b487990c4c80bffb7ac11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:32:56.536492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:56.537351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:56.538949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1007/1996] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:32:56 2022] DELETE /identity/v3/projects/c6d463d0731b487990c4c80bffb7ac11 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:56.542974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:56.552666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b2c9-7d6c-4e99-8c58-c1ad75caabc5 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:56.573967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:56.618555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:56.619474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:56.619764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:56.620096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] PATH_INFO: `/v3/users/a8e9c050426e4a53bd8a96e21144c697` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:56.621339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e9c050426e4a53bd8a96e21144c697)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:56.623421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:56.916358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e9c050426e4a53bd8a96e21144c697'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:56.928638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e9c050426e4a53bd8a96e21144c697'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:56.929325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e9c050426e4a53bd8a96e21144c697'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:57.055648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e9c050426e4a53bd8a96e21144c697'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:57.056276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d85d4411-c11d-411d-b0e4-a9055344ab68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e9c050426e4a53bd8a96e21144c697'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:57.071968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 990/1997] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:32:56 2022] DELETE /identity/v3/users/a8e9c050426e4a53bd8a96e21144c697 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:57.741456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:57.741456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:57.747808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa74eb-1c14-41c4-af7c-c9e6ee4f7485 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:57.809751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:57.810635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:57.810957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:57.811242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] PATH_INFO: `/v3/projects/3bbe78d9de364d46aa496dd20c7e2ba1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:57.812481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbe78d9de364d46aa496dd20c7e2ba1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:57.814529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:57.926752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:57.943678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbe78d9de364d46aa496dd20c7e2ba1', 'request_id': 'req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:58.034718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.035191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.035304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.051562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbe78d9de364d46aa496dd20c7e2ba1', 'request_id': 'req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:58.053731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:58.055008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:58.058020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbe78d9de364d46aa496dd20c7e2ba1', 'request_id': 'req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:58.070264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] The token cache is being invalidate because project 3bbe78d9de364d46aa496dd20c7e2ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:32:58.073200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:58.073200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70366fed-be3a-47f3-9a5a-fd8fd98c5a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:32:58.073200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1008/1998] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:32:57 2022] DELETE /identity/v3/projects/3bbe78d9de364d46aa496dd20c7e2ba1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:58.077431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a9499-ede7-4941-8866-5e0f9ba9684b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.077759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a9499-ede7-4941-8866-5e0f9ba9684b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.078108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a9499-ede7-4941-8866-5e0f9ba9684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.097130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a84a9499-ede7-4941-8866-5e0f9ba9684b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:58.098335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a84a9499-ede7-4941-8866-5e0f9ba9684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:58.124690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 991/1999] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:58.140323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:58.143638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:58.177280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1009/2000] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:32:58.184788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726348-e033-4e79-87c5-6d674639c89f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.185088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726348-e033-4e79-87c5-6d674639c89f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.185376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5726348-e033-4e79-87c5-6d674639c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.216395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f5726348-e033-4e79-87c5-6d674639c89f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:58.217724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5726348-e033-4e79-87c5-6d674639c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:58.233484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1010/2001] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:58.237900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5726348-e033-4e79-87c5-6d674639c89f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:58.240484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:58.247270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5726348-e033-4e79-87c5-6d674639c89f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:58.254502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:58.255280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.255904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.256266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.257175 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:32:58.258001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:58.259803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:58.270334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e6937-c1f0-4b93-8bdf-17046f552268 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:58.276692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:58.277684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.278114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.278449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.289985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1011/2002] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:32:58.291007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:58.291977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:58.292713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:58.303554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 992/2003] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:32:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:32:58.305687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429caf02-f2e5-4dd6-b17c-9336de81964e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:58.311605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:58.312354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.312644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.312923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.313623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:58.315978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:58.456208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1012/2004] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:32:58 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:58.457334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:58.468681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4606fb-36cf-4be9-acae-c3bfaaf3bbd4 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:58.557748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:58.558434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.558776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.559369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.559778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:58.561710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:58.672201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 993/2005] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:32:58 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:32:58.686086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:58.700242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336043ab-f385-41cf-a281-6b69ba1a48e0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:58.706566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:58.711172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.711172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.711172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.711172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:58.711172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:58.725220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1013/2006] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:58.726421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:58.740030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eab735-e748-4bae-a20d-3034d8f76357 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:58.752310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3f863-107f-45ef-b996-041706d082d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:58.753124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f863-107f-45ef-b996-041706d082d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.753484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f863-107f-45ef-b996-041706d082d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.753840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3f863-107f-45ef-b996-041706d082d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.754670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f863-107f-45ef-b996-041706d082d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:58.756437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3f863-107f-45ef-b996-041706d082d5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:58.772837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 994/2007] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:58.777764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:58.790273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba259cf2-6341-4a64-8d2c-1304090dd9af admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:58.796365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:58.797534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.797826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.798695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] PATH_INFO: `/v3/projects/fa1ccf42baad48bda1e2622d85bb5fc9/users/d172dde03ddc4ee4a08f5d3d2150d66f/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.819191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1ccf42baad48bda1e2622d85bb5fc9, user_id=d172dde03ddc4ee4a08f5d3d2150d66f, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:58.822391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:58.928534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1014/2008] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:32:58 2022] PUT /identity/v3/projects/fa1ccf42baad48bda1e2622d85bb5fc9/users/d172dde03ddc4ee4a08f5d3d2150d66f/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:58.930420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e61fc-77f9-44c5-9abe-1abce73e4976 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:58.931370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e61fc-77f9-44c5-9abe-1abce73e4976 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:58.931669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e61fc-77f9-44c5-9abe-1abce73e4976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:58.961838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-355e61fc-77f9-44c5-9abe-1abce73e4976 None None] MFA Rules not processed for user `d172dde03ddc4ee4a08f5d3d2150d66f`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:58.962549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-355e61fc-77f9-44c5-9abe-1abce73e4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:59.043485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 995/2009] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:59.048022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.110393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:59.131032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6efd6-1f1c-43e8-8a85-238aec3e9c44 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:59.136060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70f63-f6a8-45a9-9d35-f1bd6cee48b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:59.139976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70f63-f6a8-45a9-9d35-f1bd6cee48b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.139976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70f63-f6a8-45a9-9d35-f1bd6cee48b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.139976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70f63-f6a8-45a9-9d35-f1bd6cee48b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.139976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70f63-f6a8-45a9-9d35-f1bd6cee48b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:59.140297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70f63-f6a8-45a9-9d35-f1bd6cee48b5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:59.253505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1015/2010] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:32:59 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:59.257638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e61fc-77f9-44c5-9abe-1abce73e4976 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.271497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e61fc-77f9-44c5-9abe-1abce73e4976 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:59.316648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:59.332467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:59.333175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.333499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.333760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.334455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:59.336434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:59.412713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebba2-5df7-487d-9d13-d9f110c4167d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.413038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebba2-5df7-487d-9d13-d9f110c4167d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.413321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebba2-5df7-487d-9d13-d9f110c4167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.432438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a0cebba2-5df7-487d-9d13-d9f110c4167d None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:59.433652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a0cebba2-5df7-487d-9d13-d9f110c4167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:59.491264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1016/2011] 10.222.0.87 () {58 vars in 967 bytes} [Wed Jul 20 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:32:59.502390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 996/2012] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:32:59 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:32:59.506959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cebba2-5df7-487d-9d13-d9f110c4167d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.508241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.519140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cebba2-5df7-487d-9d13-d9f110c4167d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:59.524430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:59.525107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.525420 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.525703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.526463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:59.528106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:59.540082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1017/2013] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:59.544202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.555220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877598-4e11-44ca-86cd-c1b78fdcae47 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:59.559966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:59.560850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.561135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.561413 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] PATH_INFO: `/v3/projects/581c231084d2452b99c2b3a398771feb/users/6eb8ecf16fca45aeaf949840d9060804/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.577577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=581c231084d2452b99c2b3a398771feb, user_id=6eb8ecf16fca45aeaf949840d9060804, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:59.580251 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997e097-6539-49c8-a583-4409c609a998 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:59.581049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:59.585552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:59.586257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.586544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.586868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.595829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:59.597711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:59.605708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 997/2014] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:32:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:32:59.718222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1018/2015] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:32:59 2022] PUT /identity/v3/projects/581c231084d2452b99c2b3a398771feb/users/6eb8ecf16fca45aeaf949840d9060804/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:32:59.724532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.740461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ab1a-93de-4017-87a6-4d00ec24e800 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:59.799924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08d2ac-f6b8-4a31-95c6-5efa1cf1f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:59.800625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08d2ac-f6b8-4a31-95c6-5efa1cf1f459 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.803190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08d2ac-f6b8-4a31-95c6-5efa1cf1f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.803190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08d2ac-f6b8-4a31-95c6-5efa1cf1f459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.803190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08d2ac-f6b8-4a31-95c6-5efa1cf1f459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:59.803753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08d2ac-f6b8-4a31-95c6-5efa1cf1f459 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:59.814340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 998/2016] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:32:59.818276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.828610 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20e3b1-6ed3-48f3-b6af-b769bdf636bf admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:32:59.833513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:32:59.834408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.834750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.835053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] PATH_INFO: `/v3/projects/581c231084d2452b99c2b3a398771feb/users/6eb8ecf16fca45aeaf949840d9060804/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.837032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581c231084d2452b99c2b3a398771feb, user_id=6eb8ecf16fca45aeaf949840d9060804, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:32:59.839734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:32:59.850541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1019/2017] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:32:59 2022] PUT /identity/v3/projects/581c231084d2452b99c2b3a398771feb/users/6eb8ecf16fca45aeaf949840d9060804/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:32:59.862224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2a98-036e-48c7-ab5e-047dc0bf8329 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:32:59.862514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2a98-036e-48c7-ab5e-047dc0bf8329 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:32:59.862823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf2a98-036e-48c7-ab5e-047dc0bf8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:32:59.889863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4dcf2a98-036e-48c7-ab5e-047dc0bf8329 None None] MFA Rules not processed for user `6eb8ecf16fca45aeaf949840d9060804`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:32:59.893272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4dcf2a98-036e-48c7-ab5e-047dc0bf8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:32:59.939086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:59.960359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 999/2018] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:32:59.972555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:32:59.974593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:00.036302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0700d-9fbb-45f4-a7c0-1c306080a855 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:00.040311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a8995-3380-4ac2-b479-87aa1939fa1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:00.040960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8995-3380-4ac2-b479-87aa1939fa1e service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:00.041243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8995-3380-4ac2-b479-87aa1939fa1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:00.041519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8995-3380-4ac2-b479-87aa1939fa1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:00.050665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a8995-3380-4ac2-b479-87aa1939fa1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:00.052109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a8995-3380-4ac2-b479-87aa1939fa1e service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:00.062097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1020/2019] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:00.090184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2a98-036e-48c7-ab5e-047dc0bf8329 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:00.160759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf2a98-036e-48c7-ab5e-047dc0bf8329 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:00.165547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:00.166431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:00.166849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:00.167896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] PATH_INFO: `/v3/users/d172dde03ddc4ee4a08f5d3d2150d66f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:00.168562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d172dde03ddc4ee4a08f5d3d2150d66f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:00.170554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:00.405698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:00.406466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:00.406795 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:00.425174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:00.426471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:00.431435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd172dde03ddc4ee4a08f5d3d2150d66f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:00.444685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd172dde03ddc4ee4a08f5d3d2150d66f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:00.445197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:00.445937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd172dde03ddc4ee4a08f5d3d2150d66f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:00.525416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1021/2020] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:33:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:00.525416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:00.525416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:00.583568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73c104-e787-44a7-a702-5e60527fd992 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:00.588685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ed39e-81da-4cc9-b835-3c6eddea3a86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:00.589344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ed39e-81da-4cc9-b835-3c6eddea3a86 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:00.589632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ed39e-81da-4cc9-b835-3c6eddea3a86 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:00.589916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ed39e-81da-4cc9-b835-3c6eddea3a86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:00.599059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ed39e-81da-4cc9-b835-3c6eddea3a86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:00.600674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ed39e-81da-4cc9-b835-3c6eddea3a86 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:00.609632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1022/2021] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:33:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:33:01.411011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd172dde03ddc4ee4a08f5d3d2150d66f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:01.411970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd172dde03ddc4ee4a08f5d3d2150d66f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:01.439938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1000/2022] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:00 2022] DELETE /identity/v3/users/d172dde03ddc4ee4a08f5d3d2150d66f => generated 0 bytes in 1347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:01.442372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2796c-8b80-4385-9704-044c51e30822 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:01.442801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2796c-8b80-4385-9704-044c51e30822 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:01.442972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2796c-8b80-4385-9704-044c51e30822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:01.461878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b3f2796c-8b80-4385-9704-044c51e30822 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:01.463256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b3f2796c-8b80-4385-9704-044c51e30822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:01.524824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1023/2023] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:01.535613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:01.542175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:01.594579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaf0cd-dc8f-467c-92c3-c5b0eca435ee admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:01.598912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:01.599588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:01.599880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:01.600157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:01.609139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:01.610586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:01.621845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1001/2024] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:01.967180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:01.967478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:01.967787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:01.989130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:01.990735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:02.057238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1024/2025] 10.222.0.87 () {58 vars in 967 bytes} [Wed Jul 20 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:02.069952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:02.078743 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:02.138125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179646-04d6-4457-95a4-5296033ae2d4 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:02.145603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:02.146410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:02.147226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:02.147226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:02.151069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:02.152542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:02.160366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:02.162051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:02.162690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:02.169051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc4c41-45cf-47e2-9c9a-1e9cea9ac989 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:02.173248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1002/2026] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:33:02.179230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:02.179861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:02.180204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:02.180597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] PATH_INFO: `/v3/projects/fa1ccf42baad48bda1e2622d85bb5fc9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:02.181959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1ccf42baad48bda1e2622d85bb5fc9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:02.184177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:02.330895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1ccf42baad48bda1e2622d85bb5fc9', 'request_id': 'req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:02.441037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1ccf42baad48bda1e2622d85bb5fc9', 'request_id': 'req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:02.449831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1ccf42baad48bda1e2622d85bb5fc9', 'request_id': 'req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:02.462709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] The token cache is being invalidate because project fa1ccf42baad48bda1e2622d85bb5fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:02.463223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:02.463921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:02.465790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1025/2027] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:02 2022] DELETE /identity/v3/projects/fa1ccf42baad48bda1e2622d85bb5fc9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:02.469672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:02.481837 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e430-e524-4ace-b1a8-fa6f866e35be service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:02.549533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:02.550425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:02.550744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:02.551031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] PATH_INFO: `/v3/users/6eb8ecf16fca45aeaf949840d9060804` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:02.552390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb8ecf16fca45aeaf949840d9060804)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:02.554222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:02.841355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb8ecf16fca45aeaf949840d9060804'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:02.860957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb8ecf16fca45aeaf949840d9060804'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:02.861726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb8ecf16fca45aeaf949840d9060804'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:03.022584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb8ecf16fca45aeaf949840d9060804'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:03.023244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d38f1137-13cc-45f3-8c67-f4adb03353b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb8ecf16fca45aeaf949840d9060804'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:03.040233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1003/2028] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:02 2022] DELETE /identity/v3/users/6eb8ecf16fca45aeaf949840d9060804 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:03.674463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:03.676165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:03.699996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a7b47-f8eb-4dbf-8765-47caf3c26e04 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:03.765306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:03.766185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:03.766472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:03.767500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] PATH_INFO: `/v3/projects/581c231084d2452b99c2b3a398771feb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:03.768919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=581c231084d2452b99c2b3a398771feb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:03.771033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:03.914340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581c231084d2452b99c2b3a398771feb', 'request_id': 'req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:04.022878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581c231084d2452b99c2b3a398771feb', 'request_id': 'req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:04.030388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581c231084d2452b99c2b3a398771feb', 'request_id': 'req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:04.045463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] The token cache is being invalidate because project 581c231084d2452b99c2b3a398771feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:04.045757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:04.046535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-107799eb-0c40-4cf2-986f-fca1e3a3a6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:04.048841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1026/2029] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:03 2022] DELETE /identity/v3/projects/581c231084d2452b99c2b3a398771feb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:04.054377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f64f8a-da90-4726-88fe-12cc54afd424 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.054919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f64f8a-da90-4726-88fe-12cc54afd424 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.055321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f64f8a-da90-4726-88fe-12cc54afd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.076233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-64f64f8a-da90-4726-88fe-12cc54afd424 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:04.077445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-64f64f8a-da90-4726-88fe-12cc54afd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:04.088408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:04.147262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1004/2030] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:04.154779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df857-5e57-419f-be38-ff6ce4ecf9a1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.155076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df857-5e57-419f-be38-ff6ce4ecf9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.155382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0df857-5e57-419f-be38-ff6ce4ecf9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.179874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8d0df857-5e57-419f-be38-ff6ce4ecf9a1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:04.181096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8d0df857-5e57-419f-be38-ff6ce4ecf9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:04.190097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1027/2031] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:04.194442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f64f8a-da90-4726-88fe-12cc54afd424 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:04.206013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f64f8a-da90-4726-88fe-12cc54afd424 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:04.210591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:04.211300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.211590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.211869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.212629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:04.212943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:04.214541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:04.227437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1005/2032] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:33:04.231584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0df857-5e57-419f-be38-ff6ce4ecf9a1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:04.240762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0df857-5e57-419f-be38-ff6ce4ecf9a1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:04.245421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:04.246076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.246363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.246656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.247373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:04.249261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:04.253336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:04.361389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1028/2033] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:04 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:04.365717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:04.375676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89242eb-1b23-4f64-9e34-3ea197f09bb9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:04.457873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:04.458795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.459180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.459616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.460880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:04.463582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:04.600375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1006/2034] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:04 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:04.604426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:04.615361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10088-3021-46aa-b6af-dea62fff4a80 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:04.619994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:04.620772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.621067 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.621391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.622331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:04.623986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:04.634273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1029/2035] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:04.638288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:04.648393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3e935-2664-4310-92d9-65b41eacaca0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:04.655762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869897c0-60d9-4e8f-98dd-0ef890fec8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:04.655762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869897c0-60d9-4e8f-98dd-0ef890fec8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.655762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869897c0-60d9-4e8f-98dd-0ef890fec8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.655762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869897c0-60d9-4e8f-98dd-0ef890fec8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.656415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869897c0-60d9-4e8f-98dd-0ef890fec8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:04.656836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869897c0-60d9-4e8f-98dd-0ef890fec8b8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:04.667218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1007/2036] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:04.671348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:04.681977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498e20-cdb9-454f-861c-5c0df86f234f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:04.686784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:04.687783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.688080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.688361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] PATH_INFO: `/v3/projects/1e2370f4d5b9497084403af270c1d745/users/6f223bb59d2a455eadc156ef3d82414b/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.703320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2370f4d5b9497084403af270c1d745, user_id=6f223bb59d2a455eadc156ef3d82414b, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:04.706109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:04.807191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1030/2037] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:04 2022] PUT /identity/v3/projects/1e2370f4d5b9497084403af270c1d745/users/6f223bb59d2a455eadc156ef3d82414b/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:04.818321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df67a-6945-40cc-bd58-771c0b1d0830 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.818557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df67a-6945-40cc-bd58-771c0b1d0830 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.818871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df67a-6945-40cc-bd58-771c0b1d0830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.847641 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b33df67a-6945-40cc-bd58-771c0b1d0830 None None] MFA Rules not processed for user `6f223bb59d2a455eadc156ef3d82414b`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:04.849081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b33df67a-6945-40cc-bd58-771c0b1d0830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:04.914032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1008/2038] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:04.918521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:04.980513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8511e-30ab-465a-a914-258abcfd5a5a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:04.985225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:04.986091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:04.986385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:04.986692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:04.987418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:04.989342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.081549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1031/2039] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:04 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:05.085628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33df67a-6945-40cc-bd58-771c0b1d0830 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.097317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33df67a-6945-40cc-bd58-771c0b1d0830 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.154517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.155255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.155546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.155829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.156778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.159578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.250441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1009/2040] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:05 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:05.255304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.256926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.258625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:05.266287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69754ac-e4af-4e27-a993-53e77376f2dd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.271666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c615c-770e-4db4-9609-3ccfe477fa55 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.271801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.272379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.276181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.276181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.276181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.276181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.276536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.277228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.277515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.277802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] PATH_INFO: `/v3/users/e7ebbe1627704b0a84992052805e3f84` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.279041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ebbe1627704b0a84992052805e3f84)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.281015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.288925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1032/2041] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:05.291567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.301496 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eabfa-15cf-419a-8d4a-4d925ce5d0ff admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.306233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.307261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.307542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.307821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] PATH_INFO: `/v3/projects/f0edfdf7c67f402eb3a9c5eb307a2657/users/cd5972a1fbdd4c9fafaa7421f2634502/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.322868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0edfdf7c67f402eb3a9c5eb307a2657, user_id=cd5972a1fbdd4c9fafaa7421f2634502, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.325536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.353171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:05.445273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1033/2042] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:05 2022] PUT /identity/v3/projects/f0edfdf7c67f402eb3a9c5eb307a2657/users/cd5972a1fbdd4c9fafaa7421f2634502/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:33:05.450154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.492345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ebbe1627704b0a84992052805e3f84'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:05.520370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ebbe1627704b0a84992052805e3f84'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:05.523192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ebbe1627704b0a84992052805e3f84'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:05.543835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1441-2412-4a94-a2a9-6ac20d4c32ad admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.548659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.549384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.549672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.549950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.550705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.552318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.554395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:05.563144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1034/2043] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:33:05.568743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.570911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:05.584382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba6c2b-84d6-4d4f-b38c-86d51d3be9f6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.589144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa68312-9a5b-4053-b187-75bc680b2441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.590038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68312-9a5b-4053-b187-75bc680b2441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.590329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68312-9a5b-4053-b187-75bc680b2441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.591084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68312-9a5b-4053-b187-75bc680b2441 admin admin] PATH_INFO: `/v3/projects/f0edfdf7c67f402eb3a9c5eb307a2657/users/cd5972a1fbdd4c9fafaa7421f2634502/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.592874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa68312-9a5b-4053-b187-75bc680b2441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0edfdf7c67f402eb3a9c5eb307a2657, user_id=cd5972a1fbdd4c9fafaa7421f2634502, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.596193 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa68312-9a5b-4053-b187-75bc680b2441 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.607915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1035/2044] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:05 2022] PUT /identity/v3/projects/f0edfdf7c67f402eb3a9c5eb307a2657/users/cd5972a1fbdd4c9fafaa7421f2634502/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:33:05.617078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ebbe1627704b0a84992052805e3f84'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:05.618035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7b7bd2e0-ec99-4df0-bcbb-a620d104b763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ebbe1627704b0a84992052805e3f84'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:05.618340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.618664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.618959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.633249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1010/2045] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:05 2022] DELETE /identity/v3/users/e7ebbe1627704b0a84992052805e3f84 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:33:05.637630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.638003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.638361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.650310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] MFA Rules not processed for user `cd5972a1fbdd4c9fafaa7421f2634502`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:05.651963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:05.661226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:05.664823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:05.728923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1036/2046] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:05.733570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1011/2047] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:05.743712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.745038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:05.745160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:05.747960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:05.794976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:05.824384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962784b-2037-49de-829c-59d8b6d38bdc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.827524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912cf15-63a4-4e48-bbfc-56996f5f9d5d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:05.828124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.828783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.829072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.829405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.831669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:05.832328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:05.834758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:05.834758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:05.834967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:05.838785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.840254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.850007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1012/2048] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:05.902531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:05.902531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:05.911827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1037/2049] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:06.098940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:06.100792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:06.115234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fa464-3e80-4af6-a14b-c1a02c48676f service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:06.120117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:06.121163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:06.121448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:06.121728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] PATH_INFO: `/v3/projects/08e16e9fe27747cda2686971a5dc59a2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:06.123093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e16e9fe27747cda2686971a5dc59a2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:06.124908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:06.231684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e16e9fe27747cda2686971a5dc59a2', 'request_id': 'req-c9f84d2b-762c-4b91-8572-c71c7fa857a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:06.244777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e16e9fe27747cda2686971a5dc59a2', 'request_id': 'req-c9f84d2b-762c-4b91-8572-c71c7fa857a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:06.248565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e16e9fe27747cda2686971a5dc59a2', 'request_id': 'req-c9f84d2b-762c-4b91-8572-c71c7fa857a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:06.349073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] The token cache is being invalidate because project 08e16e9fe27747cda2686971a5dc59a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:06.349442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:06.350259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c9f84d2b-762c-4b91-8572-c71c7fa857a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:06.351898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1013/2050] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:06 2022] DELETE /identity/v3/projects/08e16e9fe27747cda2686971a5dc59a2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:06.825207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:06.826846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:06.847098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb801fb7-0d59-466d-9af6-7017700e27a5 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:06.873994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:06.918727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:06.919683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:06.920062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:06.920414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] PATH_INFO: `/v3/users/4426d4de2f434644890a7bec135c1c0e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:06.921697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4426d4de2f434644890a7bec135c1c0e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:06.923845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:07.196708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4426d4de2f434644890a7bec135c1c0e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:07.208709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4426d4de2f434644890a7bec135c1c0e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:07.302542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4426d4de2f434644890a7bec135c1c0e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:07.303532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4426d4de2f434644890a7bec135c1c0e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:07.304455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4426d4de2f434644890a7bec135c1c0e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:07.318134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1038/2051] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:06 2022] DELETE /identity/v3/users/4426d4de2f434644890a7bec135c1c0e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:07.322571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:07.323094 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:07.323206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:07.340870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:07.342055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:07.402325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1014/2052] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:07.413071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:07.414498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:07.473909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d91b46-eedd-43e1-90e0-422f0b19bc63 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:07.477742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb186a36-0234-4480-a36c-a361bf1c1dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:07.478393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186a36-0234-4480-a36c-a361bf1c1dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:07.478718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186a36-0234-4480-a36c-a361bf1c1dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:07.479002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186a36-0234-4480-a36c-a361bf1c1dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:07.495594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb186a36-0234-4480-a36c-a361bf1c1dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:07.495594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb186a36-0234-4480-a36c-a361bf1c1dc4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:07.503187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1039/2053] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:07.979800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:07.981274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:07.994623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067ea1-6722-434a-916a-03f7accd9d5a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:07.999786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:08.000605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.000890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.001198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] PATH_INFO: `/v3/projects/b859f3092e3b403dad1b3a8062f399f5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.002836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b859f3092e3b403dad1b3a8062f399f5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:08.004827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:08.110358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:08.120846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b859f3092e3b403dad1b3a8062f399f5', 'request_id': 'req-4b2e4dac-326b-4441-a728-87662a886319'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:08.126471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b859f3092e3b403dad1b3a8062f399f5', 'request_id': 'req-4b2e4dac-326b-4441-a728-87662a886319'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:08.132991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b859f3092e3b403dad1b3a8062f399f5', 'request_id': 'req-4b2e4dac-326b-4441-a728-87662a886319'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:08.209875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] The token cache is being invalidate because project b859f3092e3b403dad1b3a8062f399f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:08.210169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:08.210825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b2e4dac-326b-4441-a728-87662a886319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:08.212492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1015/2054] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:07 2022] DELETE /identity/v3/projects/b859f3092e3b403dad1b3a8062f399f5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:08.217488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932898e6-3205-46e0-9fa9-590a59bdc65c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.217963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932898e6-3205-46e0-9fa9-590a59bdc65c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.218075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932898e6-3205-46e0-9fa9-590a59bdc65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.239325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-932898e6-3205-46e0-9fa9-590a59bdc65c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:08.240596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-932898e6-3205-46e0-9fa9-590a59bdc65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:08.282406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:08.299924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1040/2055] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:08.307799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c31a-0fda-40d8-8cf9-796a72ca07c7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.308095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c31a-0fda-40d8-8cf9-796a72ca07c7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.308377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c31a-0fda-40d8-8cf9-796a72ca07c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.327384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4980c31a-0fda-40d8-8cf9-796a72ca07c7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:08.328601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4980c31a-0fda-40d8-8cf9-796a72ca07c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:08.337504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1016/2056] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:08.341617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932898e6-3205-46e0-9fa9-590a59bdc65c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:08.351968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932898e6-3205-46e0-9fa9-590a59bdc65c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:08.357154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:08.357807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.358095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.358377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.359231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:08.359546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:08.361327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:08.373021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1041/2057] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:33:08.377577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c31a-0fda-40d8-8cf9-796a72ca07c7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:08.387776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c31a-0fda-40d8-8cf9-796a72ca07c7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:08.393405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:08.394069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.394360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.394703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.395437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:08.397388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:08.544449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1017/2058] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:08 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:08.555514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:08.562004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17418c6e-f51e-46da-9a1b-04866bfe37f1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:08.629691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:08.630495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.630821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.631133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.631832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:08.633782 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:08.720147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1042/2059] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:08 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:08.724931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:08.735735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6452e-073a-4373-b6fc-8ceee981055a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:08.740642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:08.741384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.741712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.741994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.742758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:08.744495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:08.756056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1018/2060] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:08.760209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:08.771072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778981f7-8a4e-4ba6-b12a-bc0dcb33232a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:08.775661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd5430-7169-45ba-9718-9253773d17d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:08.776317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd5430-7169-45ba-9718-9253773d17d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.776604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd5430-7169-45ba-9718-9253773d17d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.776889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd5430-7169-45ba-9718-9253773d17d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.777611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd5430-7169-45ba-9718-9253773d17d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:08.779247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd5430-7169-45ba-9718-9253773d17d4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:08.789662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1043/2061] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:33:08.793952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:08.804149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caca618-093a-463c-a235-d90af16e47f0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:08.808765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:08.809686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.809973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.810253 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] PATH_INFO: `/v3/projects/b17605afd932496a9854fee37001cfc9/users/ca361b4643f94136932f1b2dec24b70e/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.826186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17605afd932496a9854fee37001cfc9, user_id=ca361b4643f94136932f1b2dec24b70e, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:08.828891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:08.936538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1019/2062] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:08 2022] PUT /identity/v3/projects/b17605afd932496a9854fee37001cfc9/users/ca361b4643f94136932f1b2dec24b70e/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:08.951539 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:08.951834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:08.952121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:08.980540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] MFA Rules not processed for user `ca361b4643f94136932f1b2dec24b70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:08.981982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:09.052803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1044/2063] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:09.171030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:09.171030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:09.230366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2817b6d-b942-4712-bb51-0e2eed3def3c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:09.234274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:09.235061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:09.236010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:09.236315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:09.245786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:09.251770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:09.257176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1020/2064] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:13.363670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:13.365173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:13.411160 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:13.422356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c4d5-fc1c-4fa6-b43d-837b47049b17 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:13.426503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:13.427189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:13.427480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:13.427757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:13.429519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:13.493483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:13.494953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:13.506284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1045/2065] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:14.882119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:14.890507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e3ae9-2d4f-4e24-abb5-41fedf9d474e service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:14.894769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dee238-3980-41cf-9062-67447026cbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:14.895446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee238-3980-41cf-9062-67447026cbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:14.895731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee238-3980-41cf-9062-67447026cbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:14.896008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee238-3980-41cf-9062-67447026cbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:14.897766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a5dee238-3980-41cf-9062-67447026cbf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:14.962252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:14.964830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dee238-3980-41cf-9062-67447026cbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:14.966278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dee238-3980-41cf-9062-67447026cbf5 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:14.977219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1021/2066] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:22.645911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:22.647542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:22.721300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7fa11-4b3d-4e71-9f68-60fe02ba9a1c service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:22.726122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:22.727077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:22.727384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:22.727660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] PATH_INFO: `/v3/users/6f223bb59d2a455eadc156ef3d82414b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:22.728901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f223bb59d2a455eadc156ef3d82414b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:22.730941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:23.053025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f223bb59d2a455eadc156ef3d82414b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:23.065774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f223bb59d2a455eadc156ef3d82414b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:23.165143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f223bb59d2a455eadc156ef3d82414b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:23.165697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f223bb59d2a455eadc156ef3d82414b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:23.166313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f223bb59d2a455eadc156ef3d82414b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:23.180234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1046/2067] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:22 2022] DELETE /identity/v3/users/6f223bb59d2a455eadc156ef3d82414b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:23.184948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0d3b-aab0-420f-87e8-cfee310ba1f5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:23.185416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0d3b-aab0-420f-87e8-cfee310ba1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:23.185561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0d3b-aab0-420f-87e8-cfee310ba1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:23.203722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-186f0d3b-aab0-420f-87e8-cfee310ba1f5 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:23.205026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-186f0d3b-aab0-420f-87e8-cfee310ba1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:23.275162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1022/2068] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:23.285427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:23.286917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:23.301475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:23.344877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423622d-f4de-4148-a70b-f74c02dd3d73 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:23.348538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:23.349185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:23.349472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:23.349753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:23.358669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:23.360119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:23.370042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1047/2069] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:23.623439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2651b8-6f0a-4db1-a88c-cc7ecaab62ff None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:23.623737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2651b8-6f0a-4db1-a88c-cc7ecaab62ff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:23.624021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2651b8-6f0a-4db1-a88c-cc7ecaab62ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:23.642916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9d2651b8-6f0a-4db1-a88c-cc7ecaab62ff None None] MFA Rules not processed for user `96fa33ffb9e74daa8e5a4223176ba94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:23.644125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9d2651b8-6f0a-4db1-a88c-cc7ecaab62ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:23.700924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1023/2070] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:24.037130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:24.037599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:24.056112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2110d-4fdf-4aef-b757-93384827065e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:24.062535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:24.064091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:24.064374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:24.064656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] PATH_INFO: `/v3/projects/1e2370f4d5b9497084403af270c1d745` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:24.065903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2370f4d5b9497084403af270c1d745)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:24.067955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:24.195047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2370f4d5b9497084403af270c1d745', 'request_id': 'req-0d943d86-469b-47a8-879d-c34c38d3f9ac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.290356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2370f4d5b9497084403af270c1d745', 'request_id': 'req-0d943d86-469b-47a8-879d-c34c38d3f9ac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.296860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2370f4d5b9497084403af270c1d745', 'request_id': 'req-0d943d86-469b-47a8-879d-c34c38d3f9ac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.309346 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] The token cache is being invalidate because project 1e2370f4d5b9497084403af270c1d745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:24.309636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.310285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.311871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1048/2071] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:24 2022] DELETE /identity/v3/projects/1e2370f4d5b9497084403af270c1d745 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:24.316737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2651b8-6f0a-4db1-a88c-cc7ecaab62ff None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:24.327587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2651b8-6f0a-4db1-a88c-cc7ecaab62ff None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:24.385278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:24.386161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:24.386451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:24.386767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] PATH_INFO: `/v3/users/cd5972a1fbdd4c9fafaa7421f2634502` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:24.387967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5972a1fbdd4c9fafaa7421f2634502)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:24.389929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:24.685230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:24.687787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5972a1fbdd4c9fafaa7421f2634502'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.699889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5972a1fbdd4c9fafaa7421f2634502'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.700619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5972a1fbdd4c9fafaa7421f2634502'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.862491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5972a1fbdd4c9fafaa7421f2634502'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.863206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9718a1a0-2058-442f-8e4f-44c1926a8790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5972a1fbdd4c9fafaa7421f2634502'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:24.875839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1024/2072] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:24 2022] DELETE /identity/v3/users/cd5972a1fbdd4c9fafaa7421f2634502 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:25.554230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:25.555848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:25.580903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943d86-469b-47a8-879d-c34c38d3f9ac admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:25.648278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:25.649261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:25.649516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:25.649796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] PATH_INFO: `/v3/projects/f0edfdf7c67f402eb3a9c5eb307a2657` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:25.651060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0edfdf7c67f402eb3a9c5eb307a2657)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:25.653006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:25.827495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:25.834908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0edfdf7c67f402eb3a9c5eb307a2657', 'request_id': 'req-c9a5fec2-86cb-4170-a7df-22828ee6a295'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:25.918942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0edfdf7c67f402eb3a9c5eb307a2657', 'request_id': 'req-c9a5fec2-86cb-4170-a7df-22828ee6a295'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:25.926490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0edfdf7c67f402eb3a9c5eb307a2657', 'request_id': 'req-c9a5fec2-86cb-4170-a7df-22828ee6a295'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:25.939517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] The token cache is being invalidate because project f0edfdf7c67f402eb3a9c5eb307a2657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:25.939821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:25.940491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9a5fec2-86cb-4170-a7df-22828ee6a295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:25.942319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1049/2073] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:25 2022] DELETE /identity/v3/projects/f0edfdf7c67f402eb3a9c5eb307a2657 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:25.948293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb373-53fa-4f98-9178-c9973514e925 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:25.948773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb373-53fa-4f98-9178-c9973514e925 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:25.951574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beb373-53fa-4f98-9178-c9973514e925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:25.968465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b0beb373-53fa-4f98-9178-c9973514e925 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:25.969793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b0beb373-53fa-4f98-9178-c9973514e925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:26.030708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1025/2074] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:26.039597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d44d-6270-443e-8da4-44769dfaedb2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.039890 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d44d-6270-443e-8da4-44769dfaedb2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.040176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d44d-6270-443e-8da4-44769dfaedb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.059543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f831d44d-6270-443e-8da4-44769dfaedb2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:26.060811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f831d44d-6270-443e-8da4-44769dfaedb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:26.069707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1050/2075] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:26.074155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beb373-53fa-4f98-9178-c9973514e925 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:26.085080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beb373-53fa-4f98-9178-c9973514e925 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:26.089947 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:26.090596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.090914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.091194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.091924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:26.092258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:26.093985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:26.105882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1026/2076] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:33:26.110616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831d44d-6270-443e-8da4-44769dfaedb2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:26.120049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831d44d-6270-443e-8da4-44769dfaedb2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:26.124885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:26.125551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.126401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.126827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.127629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:26.129625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:26.263714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1051/2077] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:26 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:33:26.268775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:26.278883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a812-a586-493a-bc85-0ff640183dc2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:26.340127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:26.340692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.341111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.341395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.342094 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:26.344249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:26.552878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1027/2078] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:26 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:26.557080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:26.567991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb73c4-6626-467f-83aa-2889bd1f20e1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:26.572520 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:26.573176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.573464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.573745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.574476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:26.576125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:26.587214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1052/2079] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:26.591899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:26.602072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e8b10-ddc5-4413-aa62-84f286fe30f9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:26.606588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27de53-1650-48ca-9585-66aec9f23782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:26.607272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27de53-1650-48ca-9585-66aec9f23782 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.607553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27de53-1650-48ca-9585-66aec9f23782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.607824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27de53-1650-48ca-9585-66aec9f23782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.608542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27de53-1650-48ca-9585-66aec9f23782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:26.610142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27de53-1650-48ca-9585-66aec9f23782 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:26.620914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1028/2080] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:26.624790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:26.636597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561678fb-6e33-4c94-98a5-892b2325ce75 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:26.641228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:26.642859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.643153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.643510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] PATH_INFO: `/v3/projects/a467e0f06fee48f3bae79714eaea5f49/users/54ec9fc4522d435a8467184393209094/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.661588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a467e0f06fee48f3bae79714eaea5f49, user_id=54ec9fc4522d435a8467184393209094, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:26.664464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:26.765608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1053/2081] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:26 2022] PUT /identity/v3/projects/a467e0f06fee48f3bae79714eaea5f49/users/54ec9fc4522d435a8467184393209094/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:26.778416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51df1-9f91-43c6-a551-c8a016ff31e3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.778717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51df1-9f91-43c6-a551-c8a016ff31e3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.778998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb51df1-9f91-43c6-a551-c8a016ff31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.806018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dfb51df1-9f91-43c6-a551-c8a016ff31e3 None None] MFA Rules not processed for user `54ec9fc4522d435a8467184393209094`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:26.807246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dfb51df1-9f91-43c6-a551-c8a016ff31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:26.820418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:26.871676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1029/2082] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:26.883695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:26.885416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:26.943988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae422-3036-437a-8896-34c1a54cb1f4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:26.947752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720037b9-6edd-4a2f-a171-252dd3f678dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:26.948394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720037b9-6edd-4a2f-a171-252dd3f678dc service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:26.948676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720037b9-6edd-4a2f-a171-252dd3f678dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:26.948951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720037b9-6edd-4a2f-a171-252dd3f678dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:26.957590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720037b9-6edd-4a2f-a171-252dd3f678dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:26.959124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720037b9-6edd-4a2f-a171-252dd3f678dc service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:26.968186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1054/2083] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:26.988743 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51df1-9f91-43c6-a551-c8a016ff31e3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:27.052828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb51df1-9f91-43c6-a551-c8a016ff31e3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:27.057547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:27.058456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:27.058779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:27.059061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] PATH_INFO: `/v3/users/54ec9fc4522d435a8467184393209094` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:27.060316 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ec9fc4522d435a8467184393209094)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:27.062290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:27.369396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ec9fc4522d435a8467184393209094'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:27.381698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ec9fc4522d435a8467184393209094'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:27.382446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ec9fc4522d435a8467184393209094'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:27.599711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ec9fc4522d435a8467184393209094'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:27.600368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ec9fc4522d435a8467184393209094'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:27.615114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1030/2084] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:26 2022] DELETE /identity/v3/users/54ec9fc4522d435a8467184393209094 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:27.619811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:27.620323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:27.621351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:27.640779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:27.642618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:27.726106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1055/2085] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:27.736657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:27.738251 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:27.788762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:27.789671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:27.791766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:27.808282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9cd96-4e1b-4470-ac1d-b1151e09527c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:27.809194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7952f-a263-4ba7-8810-690c302d0713 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:27.813313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff16b9c-0432-4048-93c0-bfc4a9fdeb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:27.815015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff16b9c-0432-4048-93c0-bfc4a9fdeb92 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:27.815282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff16b9c-0432-4048-93c0-bfc4a9fdeb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:27.815572 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff16b9c-0432-4048-93c0-bfc4a9fdeb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:27.816591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:27.817579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:27.817919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:27.818265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] PATH_INFO: `/v3/users/ca361b4643f94136932f1b2dec24b70e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:27.819916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca361b4643f94136932f1b2dec24b70e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:27.822274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:27.824229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:27.827043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff16b9c-0432-4048-93c0-bfc4a9fdeb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:27.828726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff16b9c-0432-4048-93c0-bfc4a9fdeb92 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:27.840247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1031/2086] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:28.143292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca361b4643f94136932f1b2dec24b70e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.158691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca361b4643f94136932f1b2dec24b70e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.285780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca361b4643f94136932f1b2dec24b70e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.286634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca361b4643f94136932f1b2dec24b70e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.287811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca361b4643f94136932f1b2dec24b70e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.302550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1056/2087] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:27 2022] DELETE /identity/v3/users/ca361b4643f94136932f1b2dec24b70e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:33:28.306768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:28.307251 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:28.307481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:28.326419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:28.327683 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:28.358986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:28.362075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:28.402271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1032/2088] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:28.419561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:28.422289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:28.467636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb6bc-b191-4042-85d0-509a49ee47c4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:28.473270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:28.474265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:28.474571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:28.474926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] PATH_INFO: `/v3/projects/a467e0f06fee48f3bae79714eaea5f49` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:28.476813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a467e0f06fee48f3bae79714eaea5f49)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:28.478902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:28.490962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d710ee-11e4-45bd-9f17-b626a72910c7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:28.501675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6390b-f148-486c-9365-ac8287f393c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:28.502955 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6390b-f148-486c-9365-ac8287f393c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:28.503461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6390b-f148-486c-9365-ac8287f393c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:28.503970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6390b-f148-486c-9365-ac8287f393c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:28.515658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6390b-f148-486c-9365-ac8287f393c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:28.517925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6390b-f148-486c-9365-ac8287f393c9 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:28.528119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1033/2089] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:28.685925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a467e0f06fee48f3bae79714eaea5f49', 'request_id': 'req-edadcb2b-041b-4568-b670-da6da488d885'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.787409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a467e0f06fee48f3bae79714eaea5f49', 'request_id': 'req-edadcb2b-041b-4568-b670-da6da488d885'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.791322 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a467e0f06fee48f3bae79714eaea5f49', 'request_id': 'req-edadcb2b-041b-4568-b670-da6da488d885'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.804365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] The token cache is being invalidate because project a467e0f06fee48f3bae79714eaea5f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:28.804658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.805357 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-edadcb2b-041b-4568-b670-da6da488d885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:28.807294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1057/2090] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:28 2022] DELETE /identity/v3/projects/a467e0f06fee48f3bae79714eaea5f49 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:28.812555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc207-4c60-485b-8026-0370c13aa6ad None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:28.812848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc207-4c60-485b-8026-0370c13aa6ad None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:28.813128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abc207-4c60-485b-8026-0370c13aa6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:28.853993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-92abc207-4c60-485b-8026-0370c13aa6ad None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:28.855873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-92abc207-4c60-485b-8026-0370c13aa6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:28.956424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2abd8b-1a06-4485-a422-5b4707960d35 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:28.956886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2abd8b-1a06-4485-a422-5b4707960d35 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:28.957177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2abd8b-1a06-4485-a422-5b4707960d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:28.960330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1034/2091] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:28.980191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3b2abd8b-1a06-4485-a422-5b4707960d35 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:28.981687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3b2abd8b-1a06-4485-a422-5b4707960d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:28.990919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1058/2092] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:28.995206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc207-4c60-485b-8026-0370c13aa6ad None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.006369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abc207-4c60-485b-8026-0370c13aa6ad None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.011326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.012006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.012323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.022375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.022375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:29.022375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.022375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.029688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1035/2093] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:33:29.033953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2abd8b-1a06-4485-a422-5b4707960d35 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.045916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2abd8b-1a06-4485-a422-5b4707960d35 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.053435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.054280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.056833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.056833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.056833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.058053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.147912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.147912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:29.147912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e4f31-f263-49a6-b3ea-c993095e5f0e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.148916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.148916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.148916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.148916 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] PATH_INFO: `/v3/projects/b17605afd932496a9854fee37001cfc9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.149236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17605afd932496a9854fee37001cfc9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.149236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.149236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:29.299205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1059/2094] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:29 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:29.308255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.316255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17605afd932496a9854fee37001cfc9', 'request_id': 'req-8f1eb82e-c715-4a65-acc3-78c466978eb4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:29.322944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17605afd932496a9854fee37001cfc9', 'request_id': 'req-8f1eb82e-c715-4a65-acc3-78c466978eb4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:29.330896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17605afd932496a9854fee37001cfc9', 'request_id': 'req-8f1eb82e-c715-4a65-acc3-78c466978eb4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:29.384491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f829d-6353-45c2-a264-14539c1f5e22 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.389370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.404475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.404475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.404475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.404475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.404475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.445916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:29.525517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] The token cache is being invalidate because project b17605afd932496a9854fee37001cfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:29.525517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:29.525517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8f1eb82e-c715-4a65-acc3-78c466978eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:29.525517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1036/2095] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:29 2022] DELETE /identity/v3/projects/b17605afd932496a9854fee37001cfc9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:33:29.528667 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97588-4e5c-4e6c-83ad-13099e4f6d52 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.528953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97588-4e5c-4e6c-83ad-13099e4f6d52 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.529229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d97588-4e5c-4e6c-83ad-13099e4f6d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.547207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d7d97588-4e5c-4e6c-83ad-13099e4f6d52 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:29.548978 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d7d97588-4e5c-4e6c-83ad-13099e4f6d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:29.556910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1037/2096] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:29.565196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a680-13e5-4740-9e90-eedb82d41aa0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.565484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a680-13e5-4740-9e90-eedb82d41aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.565765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a680-13e5-4740-9e90-eedb82d41aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.577339 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1060/2097] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:29 2022] POST /identity/v3/users => generated 286 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:29.584898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.585071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0f07a680-13e5-4740-9e90-eedb82d41aa0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:29.586382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0f07a680-13e5-4740-9e90-eedb82d41aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:29.586975 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:29.595913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1038/2098] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:29.600268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a680-13e5-4740-9e90-eedb82d41aa0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.600986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb307-0b65-436b-a8a1-2c37c5e05c7f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.606617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.607385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.607675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.607957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.608829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.609770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a680-13e5-4740-9e90-eedb82d41aa0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.611310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.615106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.615773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.616063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.616407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.617140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:29.617455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.619087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.622972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1061/2099] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:33:29.626956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.632264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1039/2100] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:33:29.636479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.636880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99803-dd4e-4be8-83e1-eef3826cedbd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.653294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.653294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.653294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.653294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.653740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.653740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.653887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b539b7-ea41-4cb3-b1e1-eb85207a46c1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.653887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.653887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.653887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.654164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.654164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.654904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.656075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1062/2101] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:29.663749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.674967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ea657-b769-47c5-8985-bad9459d0f02 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.679769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bee11-7ea7-4374-85f5-18456a013fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.680665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bee11-7ea7-4374-85f5-18456a013fda admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.680948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bee11-7ea7-4374-85f5-18456a013fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.681231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bee11-7ea7-4374-85f5-18456a013fda admin admin] PATH_INFO: `/v3/projects/00a598c0391e47689200498b41a6d4a3/users/dbac2d4bde4f43158cbaba84a4f77409/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.695804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bee11-7ea7-4374-85f5-18456a013fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a598c0391e47689200498b41a6d4a3, user_id=dbac2d4bde4f43158cbaba84a4f77409, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.698551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bee11-7ea7-4374-85f5-18456a013fda admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.773821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1040/2102] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:29 2022] POST /identity/v3/projects => generated 397 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:33:29.777881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.819305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1063/2103] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:29 2022] PUT /identity/v3/projects/00a598c0391e47689200498b41a6d4a3/users/dbac2d4bde4f43158cbaba84a4f77409/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:29.824545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105c13e-481b-499b-bf47-1573acae008d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.826042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105c13e-481b-499b-bf47-1573acae008d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.826612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105c13e-481b-499b-bf47-1573acae008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.848412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9105c13e-481b-499b-bf47-1573acae008d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:29.849714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9105c13e-481b-499b-bf47-1573acae008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:29.850866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093dba-c23a-4d1c-8b04-75d19e458af5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:29.920855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:29.923502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:29.923502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:29.923831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:29.924725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1064/2104] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:33:29.935430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:29.935430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:29.945925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105c13e-481b-499b-bf47-1573acae008d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:29.948781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9105c13e-481b-499b-bf47-1573acae008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:29.971754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:30.036777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105c13e-481b-499b-bf47-1573acae008d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:30.042293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:30.043003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:30.043292 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:30.043573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:30.046635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1041/2105] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:29 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:33:30.050304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:30.057273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:30.058781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:30.063483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385670e-155d-435f-a631-46512df2bdf7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:30.069568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1065/2106] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:33:30.069739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:30.070424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:30.070985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:30.073847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:30.076961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:30.081481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:30.093588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1042/2107] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:33:30.098077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:30.108042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5570-2d4e-4c05-ac8a-4e31f22e7975 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:30.113747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33299467-b6d8-4eb3-acfa-3fc25d13cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:30.114485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33299467-b6d8-4eb3-acfa-3fc25d13cf80 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:30.114814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33299467-b6d8-4eb3-acfa-3fc25d13cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:30.115091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33299467-b6d8-4eb3-acfa-3fc25d13cf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:30.115818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33299467-b6d8-4eb3-acfa-3fc25d13cf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:30.117481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33299467-b6d8-4eb3-acfa-3fc25d13cf80 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:30.131183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1066/2108] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:30.132353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:30.143758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb111d9-feaf-4250-b157-e5a923fa591f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:30.149535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:30.157768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:30.157768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:30.157768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] PATH_INFO: `/v3/projects/ca8b76183e1649a1a4cc165652a186d1/users/4ee6ec38a5944cf2a9205e4bc677f381/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:30.168421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8b76183e1649a1a4cc165652a186d1, user_id=4ee6ec38a5944cf2a9205e4bc677f381, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:30.171364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:30.297293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1043/2109] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:30 2022] PUT /identity/v3/projects/ca8b76183e1649a1a4cc165652a186d1/users/4ee6ec38a5944cf2a9205e4bc677f381/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:30.308742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711674-132a-4711-b33a-856ca6624829 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:30.309036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711674-132a-4711-b33a-856ca6624829 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:30.309321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711674-132a-4711-b33a-856ca6624829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:30.341356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-48711674-132a-4711-b33a-856ca6624829 None None] MFA Rules not processed for user `4ee6ec38a5944cf2a9205e4bc677f381`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:30.342582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-48711674-132a-4711-b33a-856ca6624829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:30.411241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1067/2110] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:30.422575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:30.424775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:30.480855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9cfda-d8ea-4a42-ac9d-dbcc0db41af8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:30.484843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:30.486666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:30.486961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:30.487242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:30.495852 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:30.497943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:30.510022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1044/2111] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:31.394636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:32.268721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bd2b-f3d3-4018-a439-833104e2af06 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:32.269021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bd2b-f3d3-4018-a439-833104e2af06 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:32.269309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bd2b-f3d3-4018-a439-833104e2af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:32.297681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d263bd2b-f3d3-4018-a439-833104e2af06 None None] MFA Rules not processed for user `dbac2d4bde4f43158cbaba84a4f77409`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:32.299872 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d263bd2b-f3d3-4018-a439-833104e2af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:32.368752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1068/2112] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:32.380334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:32.381750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:32.393072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6129b-f0d8-42ab-b9f9-2ff3c5b6bb55 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:32.396683 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:32.397309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:32.397589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:32.397863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:32.405928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:32.408502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:32.418402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1045/2113] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:35.509564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceba775-3c9d-4470-8f7a-00b02be49080 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:35.510264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceba775-3c9d-4470-8f7a-00b02be49080 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:35.510264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceba775-3c9d-4470-8f7a-00b02be49080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:35.528467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9ceba775-3c9d-4470-8f7a-00b02be49080 None None] MFA Rules not processed for user `dbac2d4bde4f43158cbaba84a4f77409`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:35.529695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ceba775-3c9d-4470-8f7a-00b02be49080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:35.537534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1069/2114] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:39.183707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:39.185102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:39.255103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7622f-80d0-43a0-a02c-90d5892a7350 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:39.260196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1411f-afca-4060-bdbd-70e711d5e2d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:39.260884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1411f-afca-4060-bdbd-70e711d5e2d1 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:39.261169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1411f-afca-4060-bdbd-70e711d5e2d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:39.261447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1411f-afca-4060-bdbd-70e711d5e2d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:39.263313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e8c1411f-afca-4060-bdbd-70e711d5e2d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:39.275078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1411f-afca-4060-bdbd-70e711d5e2d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:39.276739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1411f-afca-4060-bdbd-70e711d5e2d1 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:39.287510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1046/2115] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:39.542488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceba775-3c9d-4470-8f7a-00b02be49080 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:39.574605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:39.607566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceba775-3c9d-4470-8f7a-00b02be49080 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:39.612981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:39.613889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:39.614176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:39.614458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] PATH_INFO: `/v3/users/4ee6ec38a5944cf2a9205e4bc677f381` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:39.615927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee6ec38a5944cf2a9205e4bc677f381)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:39.617917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:39.870040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee6ec38a5944cf2a9205e4bc677f381'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:39.881942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee6ec38a5944cf2a9205e4bc677f381'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:39.974999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee6ec38a5944cf2a9205e4bc677f381'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:39.975647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee6ec38a5944cf2a9205e4bc677f381'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:39.976258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee6ec38a5944cf2a9205e4bc677f381'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:39.990159 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1070/2116] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:33:39 2022] DELETE /identity/v3/users/4ee6ec38a5944cf2a9205e4bc677f381 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:39.994823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:39.995212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:39.995497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:40.015495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:40.018607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:40.040698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:40.082665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1047/2117] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:40.092270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:40.093806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:40.153412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf55b3-b1e1-4476-b97f-8df7168dc22c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:40.158553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37292c7-a1c2-4069-9d6a-e04ca7bac2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:40.159229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37292c7-a1c2-4069-9d6a-e04ca7bac2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:40.159514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37292c7-a1c2-4069-9d6a-e04ca7bac2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:40.159811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37292c7-a1c2-4069-9d6a-e04ca7bac2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:40.168730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37292c7-a1c2-4069-9d6a-e04ca7bac2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:40.170151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37292c7-a1c2-4069-9d6a-e04ca7bac2f5 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:40.181043 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1071/2118] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:40.664402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:40.666766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:40.682393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c9576-a84d-48d9-be97-b37bd7f74d7f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:40.687343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:40.690998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:40.690998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:40.690998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] PATH_INFO: `/v3/projects/ca8b76183e1649a1a4cc165652a186d1` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:40.691613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8b76183e1649a1a4cc165652a186d1)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:40.693687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:40.859604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8b76183e1649a1a4cc165652a186d1', 'request_id': 'req-902a02b2-bf54-474b-ba57-6ea51bbe2cee'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:40.866219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8b76183e1649a1a4cc165652a186d1', 'request_id': 'req-902a02b2-bf54-474b-ba57-6ea51bbe2cee'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:40.873072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8b76183e1649a1a4cc165652a186d1', 'request_id': 'req-902a02b2-bf54-474b-ba57-6ea51bbe2cee'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:40.997410 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] The token cache is being invalidate because project ca8b76183e1649a1a4cc165652a186d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:33:40.997699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:40.998347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-902a02b2-bf54-474b-ba57-6ea51bbe2cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:33:41.000069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1048/2119] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:33:40 2022] DELETE /identity/v3/projects/ca8b76183e1649a1a4cc165652a186d1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:41.006133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eb512-105c-4920-b5b1-5bce5e9d5895 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.006661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eb512-105c-4920-b5b1-5bce5e9d5895 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.006866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eb512-105c-4920-b5b1-5bce5e9d5895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.025953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-806eb512-105c-4920-b5b1-5bce5e9d5895 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:41.027186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-806eb512-105c-4920-b5b1-5bce5e9d5895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:41.082465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:41.103862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1072/2120] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:41.105503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768fde-fbe5-4060-ade1-58f80311e01a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.105804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768fde-fbe5-4060-ade1-58f80311e01a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.106088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f768fde-fbe5-4060-ade1-58f80311e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.127074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8f768fde-fbe5-4060-ade1-58f80311e01a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:41.127831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8f768fde-fbe5-4060-ade1-58f80311e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:41.136335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1049/2121] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:41.151185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eb512-105c-4920-b5b1-5bce5e9d5895 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:41.163352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eb512-105c-4920-b5b1-5bce5e9d5895 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:41.168962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:41.170391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.170703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.170986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.171785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:33:41.172098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:41.175008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:41.192387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1073/2122] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:33:41.197008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768fde-fbe5-4060-ade1-58f80311e01a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:41.207724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f768fde-fbe5-4060-ade1-58f80311e01a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:41.213159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:41.213974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.214267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.214854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.215578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:41.217566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:41.373254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1050/2123] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:41 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:41.377781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:41.393388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29475dd-a136-4d11-8503-96238a18611f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:41.478313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:41.479165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.479626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.480624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.481422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:41.483514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:41.731001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1074/2124] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:41 2022] POST /identity/v3/users => generated 286 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:33:41.732199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:41.743678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2893c-1161-499d-b74f-dd0f0bb534d2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:41.748582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:41.749212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.749477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.749759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.750602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:41.752728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:41.765497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1051/2125] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:41.770476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:41.781693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92670-b08e-488e-8211-2e2a1eb75b27 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:41.787052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca04b-88f6-4dd7-8ea4-762fe50cdfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:41.787730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca04b-88f6-4dd7-8ea4-762fe50cdfeb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.788016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca04b-88f6-4dd7-8ea4-762fe50cdfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.788320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca04b-88f6-4dd7-8ea4-762fe50cdfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.789048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deca04b-88f6-4dd7-8ea4-762fe50cdfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:41.790744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deca04b-88f6-4dd7-8ea4-762fe50cdfeb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:41.801847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1075/2126] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:41.806030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:41.816618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de490593-bbb7-4526-a762-83e36d0af042 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:41.821147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:41.822027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.822345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.822625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] PATH_INFO: `/v3/projects/87eff7a42b92407381c30234c4cebaec/users/e7723c980dbe4120afe36d4796c15cfb/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:41.837540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87eff7a42b92407381c30234c4cebaec, user_id=e7723c980dbe4120afe36d4796c15cfb, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:41.840328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:41.983340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1052/2127] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:41 2022] PUT /identity/v3/projects/87eff7a42b92407381c30234c4cebaec/users/e7723c980dbe4120afe36d4796c15cfb/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:41.988781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ab80-1796-4f4c-839e-f85ab9af3f17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:41.989069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ab80-1796-4f4c-839e-f85ab9af3f17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:41.989749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ab80-1796-4f4c-839e-f85ab9af3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:42.008107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d1f0ab80-1796-4f4c-839e-f85ab9af3f17 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:42.009359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1f0ab80-1796-4f4c-839e-f85ab9af3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:42.075333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1076/2128] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:42.113925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:42.115952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:42.171466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:42.183606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d37d4-04e9-4ba0-a573-59674fac621a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:42.188715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:42.189577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:42.189970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:42.190560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:42.203032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:42.205392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:42.216887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1053/2129] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:33:49.024533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b440c-81e6-4f6e-9baa-236794a54edd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.025560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b440c-81e6-4f6e-9baa-236794a54edd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.025865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b440c-81e6-4f6e-9baa-236794a54edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.054897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c39b440c-81e6-4f6e-9baa-236794a54edd None None] MFA Rules not processed for user `e7723c980dbe4120afe36d4796c15cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:49.056176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c39b440c-81e6-4f6e-9baa-236794a54edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:49.105524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:49.126575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1077/2130] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:49.131340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:49.141576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8e6b6-f063-4b44-a19a-dbaaf8f61585 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:49.146545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:49.147261 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.147552 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.147847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.148569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:49.150500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:49.265200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1054/2131] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:33:49 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:49.269450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b440c-81e6-4f6e-9baa-236794a54edd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:49.283529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b440c-81e6-4f6e-9baa-236794a54edd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:49.347172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:49.347883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.348177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.348463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.349201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:49.351278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:49.537550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1078/2132] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:33:49 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:33:49.541468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:49.553368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485db92-9cdb-4941-b834-8d234f65a1e0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:49.558086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:49.558844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.559068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.564865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.564865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:49.564865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:49.574200 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1055/2133] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:49.578105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:49.588178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9c87-618d-4a0c-8b59-c6eadf2b9ac1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:49.592708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:49.593580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.593856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.594147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] PATH_INFO: `/v3/projects/e66c98dd287b474b9f73ce4c8d2f1992/users/df3273e4246641e1b718b51e1b2f738a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.608920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66c98dd287b474b9f73ce4c8d2f1992, user_id=df3273e4246641e1b718b51e1b2f738a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:49.612271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:49.804694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1079/2134] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:49 2022] PUT /identity/v3/projects/e66c98dd287b474b9f73ce4c8d2f1992/users/df3273e4246641e1b718b51e1b2f738a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:49.808639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:49.818841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce02735-0829-4c36-a66a-d446a9d5385a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:49.877031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262494b1-28ca-42b7-999b-28cc08491259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:49.877702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262494b1-28ca-42b7-999b-28cc08491259 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.877988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262494b1-28ca-42b7-999b-28cc08491259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.878266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262494b1-28ca-42b7-999b-28cc08491259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.879031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262494b1-28ca-42b7-999b-28cc08491259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:49.880655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262494b1-28ca-42b7-999b-28cc08491259 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:49.891028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1056/2135] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:33:49.895964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:49.907530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b366c9-3a0a-4e47-ab3c-67b327ed8513 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:49.912201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:49.913083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:49.913369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:49.913648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] PATH_INFO: `/v3/projects/e66c98dd287b474b9f73ce4c8d2f1992/users/df3273e4246641e1b718b51e1b2f738a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:49.915683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66c98dd287b474b9f73ce4c8d2f1992, user_id=df3273e4246641e1b718b51e1b2f738a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:49.918311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:49.928411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1080/2136] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:33:49 2022] PUT /identity/v3/projects/e66c98dd287b474b9f73ce4c8d2f1992/users/df3273e4246641e1b718b51e1b2f738a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:33:56.544309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341138e3-17ae-4ed1-83b2-ce82e95d9323 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:56.544839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341138e3-17ae-4ed1-83b2-ce82e95d9323 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:56.544839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341138e3-17ae-4ed1-83b2-ce82e95d9323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:56.573906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-341138e3-17ae-4ed1-83b2-ce82e95d9323 None None] MFA Rules not processed for user `df3273e4246641e1b718b51e1b2f738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:33:56.575148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-341138e3-17ae-4ed1-83b2-ce82e95d9323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:56.653285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1057/2137] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:33:56.667708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:33:56.669607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:33:56.759786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d479ac-d505-4a51-812d-1d4bbe6f1bf3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:33:56.767082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367110fb-cc68-4ce8-87b8-c21e0bbbef5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:33:56.768281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367110fb-cc68-4ce8-87b8-c21e0bbbef5b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:33:56.768772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367110fb-cc68-4ce8-87b8-c21e0bbbef5b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:33:56.769166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367110fb-cc68-4ce8-87b8-c21e0bbbef5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:33:56.808799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:56.835700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367110fb-cc68-4ce8-87b8-c21e0bbbef5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:33:56.842358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367110fb-cc68-4ce8-87b8-c21e0bbbef5b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:33:56.848337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1081/2138] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:00.256771 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262a57-c5da-4536-b514-be26fce985b9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:00.257593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262a57-c5da-4536-b514-be26fce985b9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:00.257880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262a57-c5da-4536-b514-be26fce985b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:00.277579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-77262a57-c5da-4536-b514-be26fce985b9 None None] MFA Rules not processed for user `e7723c980dbe4120afe36d4796c15cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:00.278881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-77262a57-c5da-4536-b514-be26fce985b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:00.288010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1058/2139] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:34:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:03.309571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1c46-37e6-4d6b-a4e5-0169e502d40d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:03.310132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1c46-37e6-4d6b-a4e5-0169e502d40d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:03.310132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1c46-37e6-4d6b-a4e5-0169e502d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:03.327953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ce6d1c46-37e6-4d6b-a4e5-0169e502d40d None None] MFA Rules not processed for user `dbac2d4bde4f43158cbaba84a4f77409`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:03.329171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ce6d1c46-37e6-4d6b-a4e5-0169e502d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:03.393661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1082/2140] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:10.270911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:13.386242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=36 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:20.790545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:20.791057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:20.791189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:20.810584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] MFA Rules not processed for user `f004a4778f7d46119108b09bdccb8739`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:20.811989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:20.871741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1059/2141] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:34:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:30.864748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=25 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:31.502258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9177134-55b9-4f49-8c0c-8be3f870b7b8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:31.502842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9177134-55b9-4f49-8c0c-8be3f870b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:31.502943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9177134-55b9-4f49-8c0c-8be3f870b7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:31.521889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f9177134-55b9-4f49-8c0c-8be3f870b7b8 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:31.523701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9177134-55b9-4f49-8c0c-8be3f870b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:31.579900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1083/2142] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:34:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:31.763150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:31.764570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:31.836918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7b3c3-ffd1-4c41-b82e-f7f9d1c1ffe4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:31.842178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:31.843119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:31.843119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:31.843368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:31.852475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:31.854106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:31.863278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1060/2143] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:34:41.578704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=25 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:41.859189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=32 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:47.680841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0807c56-ba84-40c7-84e0-89b55790d0e6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:47.681707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0807c56-ba84-40c7-84e0-89b55790d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:47.682175 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0807c56-ba84-40c7-84e0-89b55790d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:47.710469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f0807c56-ba84-40c7-84e0-89b55790d0e6 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:47.712625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f0807c56-ba84-40c7-84e0-89b55790d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:47.723661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1084/2144] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:34:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:47.735946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:47.751721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c00d-770e-4ff7-a86d-3a03a4380e23 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:47.760705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:47.763013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:47.763554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:47.764056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:47.782457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:47.784920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:47.799762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1061/2145] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:34:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:34:51.362004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9be1e4-c5d7-4270-a85f-8857fdff6e3c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:51.362004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9be1e4-c5d7-4270-a85f-8857fdff6e3c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:51.362004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9be1e4-c5d7-4270-a85f-8857fdff6e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:51.379050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cc9be1e4-c5d7-4270-a85f-8857fdff6e3c None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:51.380278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cc9be1e4-c5d7-4270-a85f-8857fdff6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:51.387820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1085/2146] 10.222.0.87 () {58 vars in 967 bytes} [Wed Jul 20 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:51.400541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:51.413596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7436c2d-3acf-4060-8d27-94a63e2b0675 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:51.419040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132972b-ea4f-4ada-9067-6d0be7ae02de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:51.419681 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132972b-ea4f-4ada-9067-6d0be7ae02de service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:51.419966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132972b-ea4f-4ada-9067-6d0be7ae02de service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:51.420246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132972b-ea4f-4ada-9067-6d0be7ae02de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:51.431601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132972b-ea4f-4ada-9067-6d0be7ae02de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:51.433529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132972b-ea4f-4ada-9067-6d0be7ae02de service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:51.442864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1062/2147] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:34:56.395410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bed07-92f8-482c-ad84-325dbed7807b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:56.395979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bed07-92f8-482c-ad84-325dbed7807b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:56.410012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bed07-92f8-482c-ad84-325dbed7807b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:56.410012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1086/2148] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:34:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:34:56.411969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:56.412444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:56.412536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:56.441446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] MFA Rules not processed for user `c8f8e30141ca4c95b5c11afefbb324c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:56.442996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:56.554499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1063/2149] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:34:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:56.584626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bed07-92f8-482c-ad84-325dbed7807b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:56.586428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-097bed07-92f8-482c-ad84-325dbed7807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:56.606216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bed07-92f8-482c-ad84-325dbed7807b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:56.613510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:56.614558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:56.615087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:56.615812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:56.627772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:56.632977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:56.642984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1087/2150] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:34:57.047483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:57.049007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:57.118464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa2430-7540-4099-898b-ff04e56984f4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:57.123093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:57.123968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:57.124275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:57.124556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] PATH_INFO: `/v3/users/dbac2d4bde4f43158cbaba84a4f77409` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:57.126351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbac2d4bde4f43158cbaba84a4f77409)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:57.128455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:57.159075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:57.160543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:57.222033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2198155-a670-4ebd-bf31-2a8a091f010e service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:57.226320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:57.227125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:57.227526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:57.227874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:57.244479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:57.246304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:57.257408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1088/2151] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:34:57.401231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbac2d4bde4f43158cbaba84a4f77409'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:57.415631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbac2d4bde4f43158cbaba84a4f77409'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:57.416433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbac2d4bde4f43158cbaba84a4f77409'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:57.616790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbac2d4bde4f43158cbaba84a4f77409'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:57.618318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1bb59c7f-751a-4681-9437-b2effa7505f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbac2d4bde4f43158cbaba84a4f77409'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:57.619907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:57.634978 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1064/2152] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:34:57 2022] DELETE /identity/v3/users/dbac2d4bde4f43158cbaba84a4f77409 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:34:58.002555 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:58.025192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a0bee-3bf9-4ef5-89fc-c3b72f4c877a service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:58.119838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:58.121054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:58.121502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:58.121951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] PATH_INFO: `/v3/projects/00a598c0391e47689200498b41a6d4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:58.124091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a598c0391e47689200498b41a6d4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:58.126368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:58.268476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a598c0391e47689200498b41a6d4a3', 'request_id': 'req-a19617e1-fadb-45eb-b166-b84aae31b28a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:58.365305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a598c0391e47689200498b41a6d4a3', 'request_id': 'req-a19617e1-fadb-45eb-b166-b84aae31b28a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:58.373842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a598c0391e47689200498b41a6d4a3', 'request_id': 'req-a19617e1-fadb-45eb-b166-b84aae31b28a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:58.388485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] The token cache is being invalidate because project 00a598c0391e47689200498b41a6d4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:34:58.388778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:58.389522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19617e1-fadb-45eb-b166-b84aae31b28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:34:58.396114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1089/2153] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:34:58 2022] DELETE /identity/v3/projects/00a598c0391e47689200498b41a6d4a3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:34:58.398056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f26b0-8a3e-48c8-8849-e72eac12be7b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:58.398537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f26b0-8a3e-48c8-8849-e72eac12be7b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:58.398855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f26b0-8a3e-48c8-8849-e72eac12be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:58.422462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-713f26b0-8a3e-48c8-8849-e72eac12be7b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:58.427991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-713f26b0-8a3e-48c8-8849-e72eac12be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:58.504328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1065/2154] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:58.514354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899e4f-0cd6-4333-b664-218196515d6d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:58.517549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899e4f-0cd6-4333-b664-218196515d6d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:58.517837 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd899e4f-0cd6-4333-b664-218196515d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:58.534189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:58.540917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fd899e4f-0cd6-4333-b664-218196515d6d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:58.542152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fd899e4f-0cd6-4333-b664-218196515d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:58.550858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1090/2155] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:58.555235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f26b0-8a3e-48c8-8849-e72eac12be7b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:58.567964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f26b0-8a3e-48c8-8849-e72eac12be7b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:58.572804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:58.573841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:58.574228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:58.574584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:58.575501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:34:58.576026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:58.577692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:58.595803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1066/2156] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:34:58.596652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd899e4f-0cd6-4333-b664-218196515d6d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:58.606518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd899e4f-0cd6-4333-b664-218196515d6d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:58.611825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:58.612553 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:58.612823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:58.613099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:58.613787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:58.615718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:58.799502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:58.809874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1091/2157] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:34:58 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:34:58.813413 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25d03-df40-466f-b117-3d076c3e233c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:58.881614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:58.881614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:58.882171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:58.882565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:58.883383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:58.885568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:59.043207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:59.053566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1067/2158] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:34:58 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:34:59.060838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be959adc-7c40-4d5a-a9b9-2cc744f56e9b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:59.072515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:59.074134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:59.074526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:59.074934 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:59.076623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:59.081892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:59.103941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:59.115119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1092/2159] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:34:59.119650 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404f284-68b8-4444-b6cf-05d70543c2d8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:59.128458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c8dc-9265-4fc8-a27c-3ffe5c93ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:59.130203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c8dc-9265-4fc8-a27c-3ffe5c93ddda admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:59.130203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c8dc-9265-4fc8-a27c-3ffe5c93ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:59.130203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c8dc-9265-4fc8-a27c-3ffe5c93ddda admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:59.132173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c8dc-9265-4fc8-a27c-3ffe5c93ddda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:59.133077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c8dc-9265-4fc8-a27c-3ffe5c93ddda admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:59.152657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:59.154238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1068/2160] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:34:59.170783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259452c-2e46-4886-b943-d5a5b142b060 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:59.180594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:59.182913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:59.183305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:59.184119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] PATH_INFO: `/v3/projects/b7e8c878c33a42edba11c9d8044f9ba0/users/76d3551068844a0aaf7b5b9cd1be339f/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:59.215651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e8c878c33a42edba11c9d8044f9ba0, user_id=76d3551068844a0aaf7b5b9cd1be339f, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:59.219511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:59.306957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1093/2161] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:34:59 2022] PUT /identity/v3/projects/b7e8c878c33a42edba11c9d8044f9ba0/users/76d3551068844a0aaf7b5b9cd1be339f/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:34:59.322282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b83c-12c3-4560-97ce-0f319e39e424 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:59.322620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b83c-12c3-4560-97ce-0f319e39e424 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:59.322963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7b83c-12c3-4560-97ce-0f319e39e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:59.357348 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-02e7b83c-12c3-4560-97ce-0f319e39e424 None None] MFA Rules not processed for user `76d3551068844a0aaf7b5b9cd1be339f`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:34:59.359433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-02e7b83c-12c3-4560-97ce-0f319e39e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:59.426384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:59.452832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1069/2162] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:34:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:34:59.465360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:34:59.467679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:34:59.554761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a613a-da4f-4bce-8430-03de61219eb1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:34:59.559632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f908c2-bc47-4487-a1ba-ead567c9320e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:34:59.560530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f908c2-bc47-4487-a1ba-ead567c9320e service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:34:59.561019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f908c2-bc47-4487-a1ba-ead567c9320e service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:34:59.561485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f908c2-bc47-4487-a1ba-ead567c9320e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:34:59.576947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f908c2-bc47-4487-a1ba-ead567c9320e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:34:59.578542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f908c2-bc47-4487-a1ba-ead567c9320e service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:34:59.601589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1094/2163] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:34:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:03.840482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7b83c-12c3-4560-97ce-0f319e39e424 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:03.904104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7b83c-12c3-4560-97ce-0f319e39e424 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:03.909674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:03.910540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:03.910920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:03.911201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] PATH_INFO: `/v3/users/76d3551068844a0aaf7b5b9cd1be339f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:03.912470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d3551068844a0aaf7b5b9cd1be339f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:03.914406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:04.189980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d3551068844a0aaf7b5b9cd1be339f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:04.201692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d3551068844a0aaf7b5b9cd1be339f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:04.202362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d3551068844a0aaf7b5b9cd1be339f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:04.271203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d3551068844a0aaf7b5b9cd1be339f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:04.271786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d3551068844a0aaf7b5b9cd1be339f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:04.284934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1070/2164] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:35:03 2022] DELETE /identity/v3/users/76d3551068844a0aaf7b5b9cd1be339f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:35:04.289464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:04.289972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:04.290090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:04.307634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:04.308823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:04.369079 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1095/2165] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:04.378994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:04.380405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:04.444028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4b81b-19ca-4c89-9f59-915269c52e0b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:04.447674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1f02f-b2a1-4c4a-a7c5-a91d529df797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:04.448350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f02f-b2a1-4c4a-a7c5-a91d529df797 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:04.448644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f02f-b2a1-4c4a-a7c5-a91d529df797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:04.448924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f02f-b2a1-4c4a-a7c5-a91d529df797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:04.459042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1f02f-b2a1-4c4a-a7c5-a91d529df797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:04.460549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1f02f-b2a1-4c4a-a7c5-a91d529df797 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:04.470313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1071/2166] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:04.939819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:04.941638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:04.954717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8cd11-3704-411e-bdc5-2dbe246cff86 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:04.959456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:04.960393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:04.960884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:04.961117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] PATH_INFO: `/v3/projects/b7e8c878c33a42edba11c9d8044f9ba0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:04.962374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e8c878c33a42edba11c9d8044f9ba0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:04.964314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:05.082578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:05.088796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e8c878c33a42edba11c9d8044f9ba0', 'request_id': 'req-39b9290e-0c9f-4b88-af19-b710a88e9824'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:05.250917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e8c878c33a42edba11c9d8044f9ba0', 'request_id': 'req-39b9290e-0c9f-4b88-af19-b710a88e9824'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:05.257283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e8c878c33a42edba11c9d8044f9ba0', 'request_id': 'req-39b9290e-0c9f-4b88-af19-b710a88e9824'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:05.269156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] The token cache is being invalidate because project b7e8c878c33a42edba11c9d8044f9ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:35:05.269442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:05.270094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39b9290e-0c9f-4b88-af19-b710a88e9824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:05.274446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1096/2167] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:35:04 2022] DELETE /identity/v3/projects/b7e8c878c33a42edba11c9d8044f9ba0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:35:05.276753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112b1a-2131-4d5d-b290-5af7744a6fa2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.277221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112b1a-2131-4d5d-b290-5af7744a6fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.277315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112b1a-2131-4d5d-b290-5af7744a6fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.290509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:05.296360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-17112b1a-2131-4d5d-b290-5af7744a6fa2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:05.298785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-17112b1a-2131-4d5d-b290-5af7744a6fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:05.359448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1072/2168] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:05.367565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1dd79-4f30-420b-90d8-74c222236f7f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.368077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1dd79-4f30-420b-90d8-74c222236f7f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.368207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1dd79-4f30-420b-90d8-74c222236f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.387083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bfb1dd79-4f30-420b-90d8-74c222236f7f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:05.388273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bfb1dd79-4f30-420b-90d8-74c222236f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:05.397241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1097/2169] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:05.401693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112b1a-2131-4d5d-b290-5af7744a6fa2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:05.412191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112b1a-2131-4d5d-b290-5af7744a6fa2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:05.422663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:05.422663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.422663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.422663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.423030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:35:05.423030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:05.423030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:05.434129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1073/2170] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:35:05.439399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1dd79-4f30-420b-90d8-74c222236f7f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:05.448810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1dd79-4f30-420b-90d8-74c222236f7f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:05.454096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:05.454787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.455076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.455354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.456042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:05.457974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:05.607723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1098/2171] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:35:05 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:35:05.611642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:05.622099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0f8f-3878-4146-bbc8-c1c7d6e1cf65 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:05.682835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:05.683555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.683877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.684182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.684896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:05.686853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:05.839963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1074/2172] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:35:05 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:35:05.844251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:05.854562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4793f-4d70-4384-b0b6-52862327cf4c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:05.859870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:05.860605 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.860893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.861168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.862065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:05.863637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:05.874225 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1099/2173] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:35:05.878606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:05.888644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d545a-4331-4a31-af6c-11a2618f9541 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:05.893436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52a3b0-ca2b-4fc0-adc3-91a80c527777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:05.894089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a3b0-ca2b-4fc0-adc3-91a80c527777 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.894376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a3b0-ca2b-4fc0-adc3-91a80c527777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.895233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52a3b0-ca2b-4fc0-adc3-91a80c527777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.895494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52a3b0-ca2b-4fc0-adc3-91a80c527777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:05.897098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52a3b0-ca2b-4fc0-adc3-91a80c527777 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:05.907151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1075/2174] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:35:05.911510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:05.921269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f3f2e-a53e-4983-a1b7-977cfbf9f6be admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:05.926359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:05.927277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:05.927562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:05.927861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] PATH_INFO: `/v3/projects/a85176f8e03842b9baafaf83f049b135/users/97ece70f03484fecb7109c40bb2b9524/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:05.942726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85176f8e03842b9baafaf83f049b135, user_id=97ece70f03484fecb7109c40bb2b9524, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:05.945365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:06.062135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1100/2175] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:35:05 2022] PUT /identity/v3/projects/a85176f8e03842b9baafaf83f049b135/users/97ece70f03484fecb7109c40bb2b9524/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:35:06.133288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2e7b-4e44-456c-80c3-ac97098b1f3e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:06.133582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2e7b-4e44-456c-80c3-ac97098b1f3e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:06.133866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2e7b-4e44-456c-80c3-ac97098b1f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:06.161148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3d3b2e7b-4e44-456c-80c3-ac97098b1f3e None None] MFA Rules not processed for user `97ece70f03484fecb7109c40bb2b9524`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:06.162362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3d3b2e7b-4e44-456c-80c3-ac97098b1f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:06.226062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1076/2176] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:06.237181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:06.238935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:06.295784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c416a9-ef98-4739-9097-6fc51968f693 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:06.299931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c52eb6-0a78-4aa3-bd3d-82f0a52c669f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:06.300564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52eb6-0a78-4aa3-bd3d-82f0a52c669f service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:06.300844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52eb6-0a78-4aa3-bd3d-82f0a52c669f service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:06.301120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52eb6-0a78-4aa3-bd3d-82f0a52c669f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:06.309215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c52eb6-0a78-4aa3-bd3d-82f0a52c669f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:06.310632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c52eb6-0a78-4aa3-bd3d-82f0a52c669f service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:06.320206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1101/2177] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:11.087714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08cbe-9f77-466f-b4ff-6664e3a76d76 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.087714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08cbe-9f77-466f-b4ff-6664e3a76d76 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.087714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08cbe-9f77-466f-b4ff-6664e3a76d76 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.087714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1077/2178] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:35:11.088770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75446cc-14c2-49c9-8f50-8ff4955cf452 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.089234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75446cc-14c2-49c9-8f50-8ff4955cf452 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.089378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75446cc-14c2-49c9-8f50-8ff4955cf452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.108881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c75446cc-14c2-49c9-8f50-8ff4955cf452 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:11.110774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c75446cc-14c2-49c9-8f50-8ff4955cf452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:11.168296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:11.179348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1102/2179] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:35:11.192044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08cbe-9f77-466f-b4ff-6664e3a76d76 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:11.193772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b2c08cbe-9f77-466f-b4ff-6664e3a76d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:11.200023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:11.253898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08cbe-9f77-466f-b4ff-6664e3a76d76 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:11.257548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7426a-3455-4b91-ac6a-079a0c2b8502 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:11.259014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7426a-3455-4b91-ac6a-079a0c2b8502 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.259014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7426a-3455-4b91-ac6a-079a0c2b8502 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.259014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7426a-3455-4b91-ac6a-079a0c2b8502 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.269131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7426a-3455-4b91-ac6a-079a0c2b8502 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:11.270558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7426a-3455-4b91-ac6a-079a0c2b8502 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:11.281716 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1078/2180] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:11.658024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6939-f4f4-4769-8aac-54c08ce6ed50 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.658318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6939-f4f4-4769-8aac-54c08ce6ed50 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.658601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6939-f4f4-4769-8aac-54c08ce6ed50 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.660298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1103/2181] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:35:11.664998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8d70-cd40-4cf6-92c8-b0c28ca94f2c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.665292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8d70-cd40-4cf6-92c8-b0c28ca94f2c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.665580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e8d70-cd40-4cf6-92c8-b0c28ca94f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.684705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-460e8d70-cd40-4cf6-92c8-b0c28ca94f2c None None] MFA Rules not processed for user `a1c06e34aaac441e8b1a6366cc384524`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:11.685932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-460e8d70-cd40-4cf6-92c8-b0c28ca94f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:11.738112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1079/2182] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:11.750537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6939-f4f4-4769-8aac-54c08ce6ed50 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:11.752471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bc3a6939-f4f4-4769-8aac-54c08ce6ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:11.766021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6939-f4f4-4769-8aac-54c08ce6ed50 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:11.769652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1a25e-a6b3-4ee6-b95b-a7129e1f6fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:11.770280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a25e-a6b3-4ee6-b95b-a7129e1f6fef service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.770563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a25e-a6b3-4ee6-b95b-a7129e1f6fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.770888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1a25e-a6b3-4ee6-b95b-a7129e1f6fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.777887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a25e-a6b3-4ee6-b95b-a7129e1f6fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:11.781611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1a25e-a6b3-4ee6-b95b-a7129e1f6fef service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:11.787938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1104/2183] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:11.870146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da615d1d-7cee-4412-ab32-92475b6e6aa0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.870443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da615d1d-7cee-4412-ab32-92475b6e6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.870756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da615d1d-7cee-4412-ab32-92475b6e6aa0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.872250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1080/2184] 10.222.0.87 () {54 vars in 921 bytes} [Wed Jul 20 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 15:35:11.877870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f09a9-3b75-4d04-a684-ddccf47b9581 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.878165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f09a9-3b75-4d04-a684-ddccf47b9581 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.878449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f09a9-3b75-4d04-a684-ddccf47b9581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.898083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-297f09a9-3b75-4d04-a684-ddccf47b9581 None None] MFA Rules not processed for user `c7816f91ee6e489dbe9642b5bd25a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:11.899353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-297f09a9-3b75-4d04-a684-ddccf47b9581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:11.909967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1105/2185] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Jul 20 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:11.920293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da615d1d-7cee-4412-ab32-92475b6e6aa0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:11.931528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da615d1d-7cee-4412-ab32-92475b6e6aa0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:11.935232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:11.935863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:11.936148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:11.936427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:11.947087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:11.948519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:11.960255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1081/2186] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:17.141888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478e3ea-3ba4-47eb-8781-85940a48d6ac None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:17.141888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478e3ea-3ba4-47eb-8781-85940a48d6ac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:17.141888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478e3ea-3ba4-47eb-8781-85940a48d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:17.160721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0478e3ea-3ba4-47eb-8781-85940a48d6ac None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:17.161994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0478e3ea-3ba4-47eb-8781-85940a48d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:17.222870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1106/2187] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:35:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:17.235573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:17.237274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:17.309968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd179e40-cb57-4bd4-a07d-79e669cc8e40 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:17.316854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7c4be-b343-4661-acac-cb4939f52c4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:17.317538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7c4be-b343-4661-acac-cb4939f52c4b service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:17.317844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7c4be-b343-4661-acac-cb4939f52c4b service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:17.318167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7c4be-b343-4661-acac-cb4939f52c4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:17.328603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7c4be-b343-4661-acac-cb4939f52c4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:17.330580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7c4be-b343-4661-acac-cb4939f52c4b service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:17.339990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1082/2188] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:35:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:35:21.473246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478e3ea-3ba4-47eb-8781-85940a48d6ac None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:21.551668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478e3ea-3ba4-47eb-8781-85940a48d6ac None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:21.569634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:21.570622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:21.574361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:21.574361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] PATH_INFO: `/v3/users/97ece70f03484fecb7109c40bb2b9524` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:21.574361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ece70f03484fecb7109c40bb2b9524)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:21.574361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:21.779094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ece70f03484fecb7109c40bb2b9524'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:21.794349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ece70f03484fecb7109c40bb2b9524'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:21.862391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ece70f03484fecb7109c40bb2b9524'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:21.873046 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ece70f03484fecb7109c40bb2b9524'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:21.873046 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ece70f03484fecb7109c40bb2b9524'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:21.885374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1107/2189] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:35:21 2022] DELETE /identity/v3/users/97ece70f03484fecb7109c40bb2b9524 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:35:21.889888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:21.890441 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:21.891065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:21.915076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:21.916394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:21.954036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:21.990381 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1083/2190] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:22.001235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:22.002979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:22.010071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:22.064499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8b30-b090-4436-9af6-21cf53f417b9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:22.075015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f895dfd-8b38-449f-8727-10334a5e9f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:22.076191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895dfd-8b38-449f-8727-10334a5e9f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:22.076655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895dfd-8b38-449f-8727-10334a5e9f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:22.077107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895dfd-8b38-449f-8727-10334a5e9f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:22.089852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f895dfd-8b38-449f-8727-10334a5e9f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:22.094751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f895dfd-8b38-449f-8727-10334a5e9f7f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:22.101741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1108/2191] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:22.733152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:22.735605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:22.749074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4fd8d-2885-4103-91d6-2bc989103445 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:22.764950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:22.766682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:22.767191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:22.767481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] PATH_INFO: `/v3/projects/a85176f8e03842b9baafaf83f049b135` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:22.768913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85176f8e03842b9baafaf83f049b135)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:22.770959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:22.900127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85176f8e03842b9baafaf83f049b135', 'request_id': 'req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:22.905964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85176f8e03842b9baafaf83f049b135', 'request_id': 'req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:22.914822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85176f8e03842b9baafaf83f049b135', 'request_id': 'req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:23.024108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] The token cache is being invalidate because project a85176f8e03842b9baafaf83f049b135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:35:23.024563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:23.025300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05d43fa4-2e1f-4a3e-9467-4d315adf4f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:35:23.027371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1084/2192] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:35:22 2022] DELETE /identity/v3/projects/a85176f8e03842b9baafaf83f049b135 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:35:23.033328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723d924-781f-497e-b75c-06c7d816ec6a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.033865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723d924-781f-497e-b75c-06c7d816ec6a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.033865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723d924-781f-497e-b75c-06c7d816ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.052417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9723d924-781f-497e-b75c-06c7d816ec6a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:23.053613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9723d924-781f-497e-b75c-06c7d816ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:23.123091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1109/2193] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:35:23.131908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaefa7f-88be-43e5-9836-521d95665f9b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.132196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaefa7f-88be-43e5-9836-521d95665f9b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.132478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaefa7f-88be-43e5-9836-521d95665f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.167068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-faaefa7f-88be-43e5-9836-521d95665f9b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:23.168998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-faaefa7f-88be-43e5-9836-521d95665f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:23.185210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1085/2194] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:23.191119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723d924-781f-497e-b75c-06c7d816ec6a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:23.208376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723d924-781f-497e-b75c-06c7d816ec6a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:23.221365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:23.221365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.221365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.221365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.221804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:35:23.221804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:23.221988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:23.239572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1110/2195] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:35:23.244278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaefa7f-88be-43e5-9836-521d95665f9b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:23.256353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaefa7f-88be-43e5-9836-521d95665f9b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:23.263472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:23.264565 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.265125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.266157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.267307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:23.270270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:23.427029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1086/2196] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:35:23 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:35:23.431110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:23.442218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64afe-3bf7-44d0-84ad-df1ad3a7d58c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:23.504856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:23.506182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.506475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.506787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.512472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:23.512472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:23.668206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1111/2197] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:35:23 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:35:23.672360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:23.682679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09877da3-1059-43fc-9b8b-79b6b094ff6e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:23.688102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:23.688880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.690728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.690728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.690728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:23.692110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:23.704292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1087/2198] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:35:23.708319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:23.720709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20508b-4344-440e-9cb7-ca2f6680034a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:23.725449 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b04870-83ca-45cc-9c2b-9ab28026480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:23.726124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b04870-83ca-45cc-9c2b-9ab28026480d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.726481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b04870-83ca-45cc-9c2b-9ab28026480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.726823 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b04870-83ca-45cc-9c2b-9ab28026480d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.727563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b04870-83ca-45cc-9c2b-9ab28026480d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:23.729196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b04870-83ca-45cc-9c2b-9ab28026480d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:23.739917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1112/2199] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:35:23.744082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:23.754339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582080fa-0227-4a5f-b421-08fa1d0a5416 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:23.758874 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:23.759761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.760044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.760319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] PATH_INFO: `/v3/projects/d5339dd041954c53b5904ab86091931a/users/0eb00d281e64435f9bf050eef54f9766/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.778185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5339dd041954c53b5904ab86091931a, user_id=0eb00d281e64435f9bf050eef54f9766, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:23.781549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:23.919825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1088/2200] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:35:23 2022] PUT /identity/v3/projects/d5339dd041954c53b5904ab86091931a/users/0eb00d281e64435f9bf050eef54f9766/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:35:23.925188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da854-3fb2-40cd-b502-5ef03830a316 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:23.925510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da854-3fb2-40cd-b502-5ef03830a316 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:23.925791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63da854-3fb2-40cd-b502-5ef03830a316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:23.945508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e63da854-3fb2-40cd-b502-5ef03830a316 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:23.946665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e63da854-3fb2-40cd-b502-5ef03830a316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:23.956374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:24.011581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1113/2201] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:24.024217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:24.031648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:24.113216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afd621-79bd-4338-8aba-fa6039c78c0c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:24.117318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:24.117971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:24.118256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:24.118534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:24.125863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:24.129922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:24.131592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:24.145367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1089/2202] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:25.756074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcdc6b-cc97-40e9-8f1c-8dcdd08fb84f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:25.756613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcdc6b-cc97-40e9-8f1c-8dcdd08fb84f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:25.756710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcdc6b-cc97-40e9-8f1c-8dcdd08fb84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:25.793824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c9dcdc6b-cc97-40e9-8f1c-8dcdd08fb84f None None] MFA Rules not processed for user `0eb00d281e64435f9bf050eef54f9766`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:25.793824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c9dcdc6b-cc97-40e9-8f1c-8dcdd08fb84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:25.913143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1114/2203] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:25.926343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:25.927960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:26.006818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dee8f-cafc-46e5-a39d-16bb925e525d service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:26.010523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c5dea-49d7-43ee-8eb2-e3aa02fd4054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:26.011300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c5dea-49d7-43ee-8eb2-e3aa02fd4054 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:26.011707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c5dea-49d7-43ee-8eb2-e3aa02fd4054 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:26.012215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c5dea-49d7-43ee-8eb2-e3aa02fd4054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:26.023575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c5dea-49d7-43ee-8eb2-e3aa02fd4054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:26.025271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c5dea-49d7-43ee-8eb2-e3aa02fd4054 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:26.039661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1090/2204] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:27.248087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcdc6b-cc97-40e9-8f1c-8dcdd08fb84f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:27.259879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcdc6b-cc97-40e9-8f1c-8dcdd08fb84f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:27.263802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:27.264465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:27.264750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:27.265061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:27.267120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:27.349224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:27.350712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:27.363986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1115/2205] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:29.180929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:29.180929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:29.180929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:29.197660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] MFA Rules not processed for user `0eb00d281e64435f9bf050eef54f9766`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:29.198896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:29.206482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1091/2206] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:35:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:31.185557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:31.188181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:31.198915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89441c8d-1120-4f53-9dca-633c085a428a service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:31.203398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a1bbb-0757-472b-9329-59a9ca745dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:31.203960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a1bbb-0757-472b-9329-59a9ca745dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:31.204247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a1bbb-0757-472b-9329-59a9ca745dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:31.204532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a1bbb-0757-472b-9329-59a9ca745dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:31.206512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2f1a1bbb-0757-472b-9329-59a9ca745dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:31.221753 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a1bbb-0757-472b-9329-59a9ca745dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:31.223318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a1bbb-0757-472b-9329-59a9ca745dbf service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:31.246205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1116/2207] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:39.192993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=32 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:41.230725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:46.627504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:46.628985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:46.644926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffa128-0e4d-4639-b176-e56d72d576b2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:46.650360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:46.651032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:46.651319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:46.651600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:46.653466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:46.715288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:46.718803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:46.729797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1092/2208] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:35:49.843826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:49.844331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:49.844494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:49.863431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:35:49.864717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:49.920691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1117/2209] 10.222.0.87 () {58 vars in 967 bytes} [Wed Jul 20 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:35:49.943249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:49.944657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:50.013000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe5d0-8b43-451f-8bda-4e618accd88f service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:50.018177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:50.018889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:50.019177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:50.019456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:50.027764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:50.029347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:50.038548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1093/2210] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:35:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:35:51.372798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:35:51.375199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:51.392255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027af0b-204c-4f02-bb3e-4d1419b9cf47 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:35:51.397916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0970182-2f25-4515-861f-cdb8cf76d96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:35:51.398573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0970182-2f25-4515-861f-cdb8cf76d96d service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:35:51.398893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0970182-2f25-4515-861f-cdb8cf76d96d service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:35:51.399174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0970182-2f25-4515-861f-cdb8cf76d96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:35:51.400933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b0970182-2f25-4515-861f-cdb8cf76d96d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:35:51.463040 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0970182-2f25-4515-861f-cdb8cf76d96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:35:51.464696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0970182-2f25-4515-861f-cdb8cf76d96d service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:35:51.474776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1118/2211] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:35:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:00.035408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=60 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:01.470382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=53 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:09.508797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:09.524307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766a840-602f-4d36-a6c4-6b5188e0b938 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:09.524307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:09.524307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:09.524307 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:09.524723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:09.526255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:09.537635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:09.539105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:09.547503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1094/2212] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:13.902516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791444-1e65-4574-8dc6-2e5218ceea6f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:13.903074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791444-1e65-4574-8dc6-2e5218ceea6f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:13.903170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791444-1e65-4574-8dc6-2e5218ceea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:13.922962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a8791444-1e65-4574-8dc6-2e5218ceea6f None None] MFA Rules not processed for user `96fa33ffb9e74daa8e5a4223176ba94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:13.924156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a8791444-1e65-4574-8dc6-2e5218ceea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:13.931296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1119/2213] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:36:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:19.543554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:20.089420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:20.103430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6239a58-3f01-473d-be7f-15b8cdae3666 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:20.109078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e96f81-41e8-44c6-a4a1-efd199c1e88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:20.109713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96f81-41e8-44c6-a4a1-efd199c1e88d service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:20.110002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96f81-41e8-44c6-a4a1-efd199c1e88d service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:20.110288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e96f81-41e8-44c6-a4a1-efd199c1e88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:20.112112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a8e96f81-41e8-44c6-a4a1-efd199c1e88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:20.171399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e96f81-41e8-44c6-a4a1-efd199c1e88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:20.173007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e96f81-41e8-44c6-a4a1-efd199c1e88d service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:20.182331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1095/2214] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:21.626205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8791444-1e65-4574-8dc6-2e5218ceea6f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:21.640633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8791444-1e65-4574-8dc6-2e5218ceea6f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:21.646464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:21.647150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:21.647433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:21.647720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:21.649864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:21.664044 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:21.665627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:21.677665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1120/2215] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:28.630301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e72ec-9cb4-4415-a8ed-560080194546 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:28.630841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e72ec-9cb4-4415-a8ed-560080194546 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:28.630954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e72ec-9cb4-4415-a8ed-560080194546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:28.649288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-723e72ec-9cb4-4415-a8ed-560080194546 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:28.650466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-723e72ec-9cb4-4415-a8ed-560080194546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:28.658526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1096/2216] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:28.688613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:28.699677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646eb2d-61e8-42b3-9801-d7384d35cc80 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:28.705848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:28.706481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:28.706808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:28.707091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:28.715220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:28.716798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:28.726918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1121/2217] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:35.095831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa068c-f13e-4f4b-8e2f-cf6f76886db1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:35.096434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa068c-f13e-4f4b-8e2f-cf6f76886db1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:35.096434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa068c-f13e-4f4b-8e2f-cf6f76886db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:35.115043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-99aa068c-f13e-4f4b-8e2f-cf6f76886db1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:35.116337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-99aa068c-f13e-4f4b-8e2f-cf6f76886db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:35.124522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1097/2218] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:35.162903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:35.174740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7077a8d-56e4-4277-80d9-a0e6a0cc94ba service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:35.180453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:35.181098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:35.181383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:35.181665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:35.191036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:35.192649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:35.203615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1122/2219] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:41.706459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569321fd-3b14-489c-b11e-84f3deecc4e8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:41.706953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569321fd-3b14-489c-b11e-84f3deecc4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:41.707306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569321fd-3b14-489c-b11e-84f3deecc4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:41.731822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-569321fd-3b14-489c-b11e-84f3deecc4e8 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:41.734248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-569321fd-3b14-489c-b11e-84f3deecc4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:41.744345 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1098/2220] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:41.772609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:41.778869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=22 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:41.787424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8128-4812-4330-9173-8212b2232ac7 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:41.793675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414c6dc-2f27-4759-806f-0cff2490ee2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:41.794335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c6dc-2f27-4759-806f-0cff2490ee2b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:41.794623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c6dc-2f27-4759-806f-0cff2490ee2b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:41.794928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c6dc-2f27-4759-806f-0cff2490ee2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:41.805600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414c6dc-2f27-4759-806f-0cff2490ee2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:41.807409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414c6dc-2f27-4759-806f-0cff2490ee2b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:41.818178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1123/2221] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:44.230743 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569321fd-3b14-489c-b11e-84f3deecc4e8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:44.243780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569321fd-3b14-489c-b11e-84f3deecc4e8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:44.249939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:44.250580 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:44.250939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:44.251226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:44.253110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:44.317357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:44.318898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:44.329027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1099/2222] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:47.558494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd91b-e175-4ddb-9744-31a2656fbf3d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:47.559075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd91b-e175-4ddb-9744-31a2656fbf3d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:47.559075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdd91b-e175-4ddb-9744-31a2656fbf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:47.577598 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b4fdd91b-e175-4ddb-9744-31a2656fbf3d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:47.578847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b4fdd91b-e175-4ddb-9744-31a2656fbf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:47.586901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1124/2223] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:47.610002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:47.621377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce9a6-7d74-401a-a2fe-4b99f4671bb5 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:47.627895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937f519-4ee9-4a90-87bc-af4c8319dc84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:47.640393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937f519-4ee9-4a90-87bc-af4c8319dc84 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:47.640393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937f519-4ee9-4a90-87bc-af4c8319dc84 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:47.640393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937f519-4ee9-4a90-87bc-af4c8319dc84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:47.640393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937f519-4ee9-4a90-87bc-af4c8319dc84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:47.640393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937f519-4ee9-4a90-87bc-af4c8319dc84 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:47.649377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1100/2224] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:49.153988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdd91b-e175-4ddb-9744-31a2656fbf3d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:49.168479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdd91b-e175-4ddb-9744-31a2656fbf3d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:49.174908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:49.175856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:49.176264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:49.176645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:49.178587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:49.192548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:49.194337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:49.206199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1125/2225] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:53.940753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be3ed-ef42-4f42-9c69-894004acd0b5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:53.941271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be3ed-ef42-4f42-9c69-894004acd0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:53.941474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be3ed-ef42-4f42-9c69-894004acd0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:53.954709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=72 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:53.961723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-381be3ed-ef42-4f42-9c69-894004acd0b5 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:53.962993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-381be3ed-ef42-4f42-9c69-894004acd0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:53.972147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1101/2226] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:36:53.993266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:54.006072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff35cd-abc4-4645-9576-3490527cd2fe service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:54.009974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:54.010669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:54.010955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:54.011237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:54.020274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:54.021842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:54.032349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1126/2227] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:36:59.362072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0059-f766-4d5c-8c5d-d813a0e95f99 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:59.362634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0059-f766-4d5c-8c5d-d813a0e95f99 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:59.362760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0059-f766-4d5c-8c5d-d813a0e95f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:59.382101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-af4b0059-f766-4d5c-8c5d-d813a0e95f99 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:36:59.383466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-af4b0059-f766-4d5c-8c5d-d813a0e95f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:36:59.394045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1102/2228] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:36:59.418916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:36:59.431007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3a577-8931-41b9-8eda-e134635081e8 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:36:59.437963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:36:59.438666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:36:59.438973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:36:59.439255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:36:59.447998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:36:59.449835 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:36:59.461997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1127/2229] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:37:09.376894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:09.457800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=26 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:09.762092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:09.762382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:09.762684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:09.781882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] MFA Rules not processed for user `f004a4778f7d46119108b09bdccb8739`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:09.783149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:09.790769 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1103/2230] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:37:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:10.105354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:10.114824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9129de-8440-4c49-bdb1-33c26fb91b70 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:10.118447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:10.119129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:10.119416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:10.119694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:10.121476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:10.131948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:10.133373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:10.141889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1128/2231] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:37:10.592784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:10.594224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:10.666035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f95a9-10fd-4b41-aaa8-33e31383267d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:10.671610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da129a-50f5-43da-9ba4-65f69a77a844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:10.672255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da129a-50f5-43da-9ba4-65f69a77a844 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:10.672544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da129a-50f5-43da-9ba4-65f69a77a844 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:10.672845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da129a-50f5-43da-9ba4-65f69a77a844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:10.674594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-60da129a-50f5-43da-9ba4-65f69a77a844 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:10.686575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da129a-50f5-43da-9ba4-65f69a77a844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:10.688182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da129a-50f5-43da-9ba4-65f69a77a844 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:10.697994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1104/2232] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:37:11.148601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:11.163199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7c4ce-3236-435e-8230-40b14ed85ee4 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:11.169096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff602ce-dbc1-4ac9-83a3-7f8ca513a29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:11.169747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff602ce-dbc1-4ac9-83a3-7f8ca513a29b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:11.170842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff602ce-dbc1-4ac9-83a3-7f8ca513a29b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:11.170842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff602ce-dbc1-4ac9-83a3-7f8ca513a29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:11.196123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8ff602ce-dbc1-4ac9-83a3-7f8ca513a29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:11.234004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff602ce-dbc1-4ac9-83a3-7f8ca513a29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:11.235617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff602ce-dbc1-4ac9-83a3-7f8ca513a29b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:11.244762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1129/2233] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:37:20.693878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=35 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:21.240457 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=34 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:21.252471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778077e5-940f-4ce7-8f40-e5823004a5f8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:21.252689 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778077e5-940f-4ce7-8f40-e5823004a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:21.252968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778077e5-940f-4ce7-8f40-e5823004a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:21.270953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-778077e5-940f-4ce7-8f40-e5823004a5f8 None None] MFA Rules not processed for user `0eb00d281e64435f9bf050eef54f9766`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:21.272154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-778077e5-940f-4ce7-8f40-e5823004a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:21.278991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1105/2234] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:37:26.350286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f700aa-3de4-4d26-b08b-e174e9bc3e87 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:26.350928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f700aa-3de4-4d26-b08b-e174e9bc3e87 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:26.351223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f700aa-3de4-4d26-b08b-e174e9bc3e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:26.374145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-19f700aa-3de4-4d26-b08b-e174e9bc3e87 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:26.376112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-19f700aa-3de4-4d26-b08b-e174e9bc3e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:26.383706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1130/2235] 10.222.0.87 () {58 vars in 967 bytes} [Wed Jul 20 15:37:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:26.559531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778077e5-940f-4ce7-8f40-e5823004a5f8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:26.572822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778077e5-940f-4ce7-8f40-e5823004a5f8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:26.578198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:26.579113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:26.579399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:26.579679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:26.592266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:26.594091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:26.602514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1106/2236] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:37:26.750727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f700aa-3de4-4d26-b08b-e174e9bc3e87 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:26.764290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f700aa-3de4-4d26-b08b-e174e9bc3e87 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:26.769834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:26.770480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:26.770809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:26.771156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:26.772950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:26.788783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:26.788783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:26.800537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1131/2237] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:37:27.890663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:27.900506 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6564d-2c6d-4fb8-8090-470bab48d55d service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:27.906250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:27.906928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:27.907271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:27.907676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:27.909698 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:27.923039 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:27.924974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:27.938012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1107/2238] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:37:33.572347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:33.573652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:33.594237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5e23d-a5e7-4793-91f2-a8497b0934d1 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:33.600627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:33.601698 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:33.602268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:33.602773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:33.604824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:33.619253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:33.623076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:33.636473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1132/2239] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:37:37.931939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=15 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:37.965093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:37.967031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:37.979239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb345899-5237-45f0-831b-c565f23657c0 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:37.984013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:37.984879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:37.985165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:37.985443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] PATH_INFO: `/v3/users/0cb483ff24aa45cd9ce01152374c9e4e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:37.986628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb483ff24aa45cd9ce01152374c9e4e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:37.988603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:38.192286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb483ff24aa45cd9ce01152374c9e4e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:38.204135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb483ff24aa45cd9ce01152374c9e4e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:38.204827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb483ff24aa45cd9ce01152374c9e4e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:38.400943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb483ff24aa45cd9ce01152374c9e4e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:38.401639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb483ff24aa45cd9ce01152374c9e4e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:38.415618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1108/2240] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:37:37 2022] DELETE /identity/v3/users/0cb483ff24aa45cd9ce01152374c9e4e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:37:38.757119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:38.776343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94106707-1479-40f3-bfb7-7ae037023832 service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:38.845664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:38.846536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:38.846859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:38.847144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] PATH_INFO: `/v3/projects/3f756cddc30a4f33b66772529334d8a8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:38.848334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f756cddc30a4f33b66772529334d8a8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:38.850379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:38.975719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f756cddc30a4f33b66772529334d8a8', 'request_id': 'req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.050587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f756cddc30a4f33b66772529334d8a8', 'request_id': 'req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.057107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f756cddc30a4f33b66772529334d8a8', 'request_id': 'req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.069059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] The token cache is being invalidate because project 3f756cddc30a4f33b66772529334d8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:37:39.069352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.070006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.071602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1133/2241] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:37:38 2022] DELETE /identity/v3/projects/3f756cddc30a4f33b66772529334d8a8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:37:39.075697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:39.077697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:39.099480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81e3e8-f51f-473e-aa38-1dfb73d438a7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:39.174424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:39.176151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:39.176520 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:39.176875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] PATH_INFO: `/v3/users/71f04b7b38234718a39ebd1256df6d3c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:39.178310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f04b7b38234718a39ebd1256df6d3c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:39.180593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:39.394064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f04b7b38234718a39ebd1256df6d3c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.409002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f04b7b38234718a39ebd1256df6d3c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.415243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f04b7b38234718a39ebd1256df6d3c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.537969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f04b7b38234718a39ebd1256df6d3c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.538619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-315cd94a-368f-4009-99e0-208327405155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f04b7b38234718a39ebd1256df6d3c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:39.541052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:39.552522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1109/2242] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:37:39 2022] DELETE /identity/v3/users/71f04b7b38234718a39ebd1256df6d3c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:37:39.865452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:39.866998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:39.879916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2634a-6a24-4734-a39d-e7a629eeb3f2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:39.934754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:39.941096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:39.941980 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:39.942260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:39.942536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] PATH_INFO: `/v3/projects/688c930255df4ea38661c6b60b433814` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:39.943770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688c930255df4ea38661c6b60b433814)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:39.945712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:40.068209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688c930255df4ea38661c6b60b433814', 'request_id': 'req-4d574159-bcb6-4c32-b912-824fdc355978'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:40.161480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688c930255df4ea38661c6b60b433814', 'request_id': 'req-4d574159-bcb6-4c32-b912-824fdc355978'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:40.173696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688c930255df4ea38661c6b60b433814', 'request_id': 'req-4d574159-bcb6-4c32-b912-824fdc355978'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:40.195309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] The token cache is being invalidate because project 688c930255df4ea38661c6b60b433814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:37:40.199144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:40.199144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d574159-bcb6-4c32-b912-824fdc355978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:37:40.199668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1134/2243] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:37:39 2022] DELETE /identity/v3/projects/688c930255df4ea38661c6b60b433814 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:37:40.430689 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:40.431624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:40.431624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:40.450780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] MFA Rules not processed for user `a71a9f43fc024c188e6b5285b9d81c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:40.452817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:40.508845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1110/2244] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:50.475051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:50.501723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=29 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:50.915722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586892e-4fcf-41d9-842c-fa6bb0e91fd1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:50.916078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586892e-4fcf-41d9-842c-fa6bb0e91fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:50.916359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586892e-4fcf-41d9-842c-fa6bb0e91fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:50.935767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b586892e-4fcf-41d9-842c-fa6bb0e91fd1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:50.937026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b586892e-4fcf-41d9-842c-fa6bb0e91fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:51.007199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1135/2245] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:51.031913 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:51.033554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:51.132867 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a97b6-11d8-4632-b490-38eef16d4a67 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:51.139806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:51.141332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:51.141332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:51.141332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:51.150547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:51.152358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:51.163437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1111/2246] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:37:58.713564 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b0b21-a068-4d77-9dfb-cc06f5a9a41d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:58.714117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b0b21-a068-4d77-9dfb-cc06f5a9a41d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:58.714558 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b0b21-a068-4d77-9dfb-cc06f5a9a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:58.735234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-440b0b21-a068-4d77-9dfb-cc06f5a9a41d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:37:58.736611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-440b0b21-a068-4d77-9dfb-cc06f5a9a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:37:58.745009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1136/2247] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:37:58.767869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:37:58.779295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c558e64-9869-4eac-b950-cacad0c64d89 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:37:58.784965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:37:58.785567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:37:58.785883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:37:58.786151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:37:58.796875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:37:58.798628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:37:58.809128 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1112/2248] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:02.653545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589bf51-50ba-4173-9287-3aecb884bd30 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.654177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589bf51-50ba-4173-9287-3aecb884bd30 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.654622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589bf51-50ba-4173-9287-3aecb884bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.673392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1589bf51-50ba-4173-9287-3aecb884bd30 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:02.674595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1589bf51-50ba-4173-9287-3aecb884bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:02.683200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1137/2249] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:02.704499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:02.706037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:02.721827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320207a4-d103-40a6-8657-4d0199bc60b8 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:02.733266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ee4c2-0909-4dad-a675-ea17caaf1df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:02.734331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ee4c2-0909-4dad-a675-ea17caaf1df3 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:02.734331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ee4c2-0909-4dad-a675-ea17caaf1df3 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:02.734518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ee4c2-0909-4dad-a675-ea17caaf1df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:02.745395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ee4c2-0909-4dad-a675-ea17caaf1df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:02.749021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ee4c2-0909-4dad-a675-ea17caaf1df3 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:02.762418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1113/2250] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:07.705002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55714c-e6d4-44b2-be1a-ce47b0cba913 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:07.709487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55714c-e6d4-44b2-be1a-ce47b0cba913 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:07.709487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55714c-e6d4-44b2-be1a-ce47b0cba913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:07.724081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3b55714c-e6d4-44b2-be1a-ce47b0cba913 None None] MFA Rules not processed for user `760a7a314a9c4a788e751ce19c13ff93`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:07.725121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3b55714c-e6d4-44b2-be1a-ce47b0cba913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:07.781278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1138/2251] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:11.075366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:11.076493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:11.076709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:11.097291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:11.098561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:11.107203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1114/2252] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:11.139761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55714c-e6d4-44b2-be1a-ce47b0cba913 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:11.157199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55714c-e6d4-44b2-be1a-ce47b0cba913 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:11.164718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269f6ed-8f5b-43b7-9398-ee63a40ca222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:11.178108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f6ed-8f5b-43b7-9398-ee63a40ca222 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:11.178108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f6ed-8f5b-43b7-9398-ee63a40ca222 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:11.178108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269f6ed-8f5b-43b7-9398-ee63a40ca222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:11.178108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269f6ed-8f5b-43b7-9398-ee63a40ca222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:11.178108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269f6ed-8f5b-43b7-9398-ee63a40ca222 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:11.190054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1139/2253] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:11.447317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:11.448725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:11.512761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9a5c-614a-43b8-a0d1-18e73bf9500c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:11.516498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:11.517143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:11.517427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:11.517703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:11.519573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:11.531509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:11.532944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:11.542703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1115/2254] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:15.418356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:15.418960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:15.418960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:15.550128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:15.551724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:15.586296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:15.615218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1140/2255] 10.222.0.86 () {58 vars in 1016 bytes} [Wed Jul 20 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:15.641150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:15.676955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:15.678682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:15.699739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c47a7-b6e2-4cb0-86cf-606fa1f1ff0d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:15.710722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:15.711812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:15.712636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:15.712636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] PATH_INFO: `/v3/users/96fa33ffb9e74daa8e5a4223176ba94f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:15.713647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fa33ffb9e74daa8e5a4223176ba94f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:15.716177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:15.740458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:15.745452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc42611-bab0-44ad-a9bc-7b12f2768f6b service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:15.752357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:15.753040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:15.753395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:15.753744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:15.762540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:15.764846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:15.775007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1116/2256] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:15.963073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fa33ffb9e74daa8e5a4223176ba94f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:15.982305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fa33ffb9e74daa8e5a4223176ba94f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.126907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fa33ffb9e74daa8e5a4223176ba94f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.127735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fa33ffb9e74daa8e5a4223176ba94f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.128661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cf5764d0-3ff8-4aa4-a9b0-d6292710e1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fa33ffb9e74daa8e5a4223176ba94f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.143549 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1141/2257] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:15 2022] DELETE /identity/v3/users/96fa33ffb9e74daa8e5a4223176ba94f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:16.419627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:16.429601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0f50-fe43-4675-af22-a7b031d03054 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:16.488377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:16.489246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:16.489530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:16.489807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] PATH_INFO: `/v3/projects/83fc25cdd57f4c10831269921b420f70` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:16.491069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83fc25cdd57f4c10831269921b420f70)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:16.492981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:16.655585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83fc25cdd57f4c10831269921b420f70', 'request_id': 'req-7084a65f-f54e-4418-b0c4-14297cd388f0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.661099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83fc25cdd57f4c10831269921b420f70', 'request_id': 'req-7084a65f-f54e-4418-b0c4-14297cd388f0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.667551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83fc25cdd57f4c10831269921b420f70', 'request_id': 'req-7084a65f-f54e-4418-b0c4-14297cd388f0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.759434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] The token cache is being invalidate because project 83fc25cdd57f4c10831269921b420f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:16.759830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.770868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7084a65f-f54e-4418-b0c4-14297cd388f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:16.770868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1117/2258] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:16 2022] DELETE /identity/v3/projects/83fc25cdd57f4c10831269921b420f70 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:16.771117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3497-b9be-40b0-88f1-0819a23b4567 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:16.771117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3497-b9be-40b0-88f1-0819a23b4567 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:16.771117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3497-b9be-40b0-88f1-0819a23b4567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:16.788938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f47c3497-b9be-40b0-88f1-0819a23b4567 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:16.790136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f47c3497-b9be-40b0-88f1-0819a23b4567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:16.856849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1142/2259] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:16.865663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355237-1d05-4d3b-92a6-3d1230c0b3ef None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:16.866057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355237-1d05-4d3b-92a6-3d1230c0b3ef None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:16.866403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355237-1d05-4d3b-92a6-3d1230c0b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:16.885919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c6355237-1d05-4d3b-92a6-3d1230c0b3ef None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:16.887183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c6355237-1d05-4d3b-92a6-3d1230c0b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:16.896343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1118/2260] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:16.900237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3497-b9be-40b0-88f1-0819a23b4567 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:16.918943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3497-b9be-40b0-88f1-0819a23b4567 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:16.924124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:16.924912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:16.925202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:16.925483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:16.926222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:16.926531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:16.928188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:16.942463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1143/2261] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:38:16.946922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355237-1d05-4d3b-92a6-3d1230c0b3ef None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:16.957112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355237-1d05-4d3b-92a6-3d1230c0b3ef None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:16.961941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:16.962593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:16.962912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:16.963297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:16.964009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:16.966044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:17.093303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1119/2262] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:16 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:17.097422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:17.107903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131301d-abcd-40f5-b2fb-ed1b7a903d73 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:17.148596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:17.176123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:17.176906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:17.177193 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:17.177475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:17.178242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:17.180371 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:17.301122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1144/2263] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:17 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:17.302430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:17.313625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7fade-a8bd-4869-af6d-cafd0fb23af9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:17.318215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:17.318905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:17.319201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:17.319486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:17.323905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:17.323905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:17.332715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1120/2264] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:17.336747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:17.346847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015160-cc50-4501-8791-6fa93226fb19 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:17.351470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9afb-54e4-42e1-94a6-4638c5c45693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:17.352129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9afb-54e4-42e1-94a6-4638c5c45693 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:17.357215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9afb-54e4-42e1-94a6-4638c5c45693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:17.357215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9afb-54e4-42e1-94a6-4638c5c45693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:17.357215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9afb-54e4-42e1-94a6-4638c5c45693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:17.357215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9afb-54e4-42e1-94a6-4638c5c45693 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:17.365218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1145/2265] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:17.369240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:17.379421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310c4fa-1c5d-4e0b-983e-2881578eb2ae admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:17.383948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:17.384820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:17.385102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:17.385377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] PATH_INFO: `/v3/projects/d1e532506150434aa610356d0e643dc6/users/2f7a707aedac4e81ad6df015a2a22392/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:17.401277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e532506150434aa610356d0e643dc6, user_id=2f7a707aedac4e81ad6df015a2a22392, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:17.404734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:17.514842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1121/2266] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:17 2022] PUT /identity/v3/projects/d1e532506150434aa610356d0e643dc6/users/2f7a707aedac4e81ad6df015a2a22392/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:17.524994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58dba9-d812-449f-bad3-4a2a0ff09740 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:17.525294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58dba9-d812-449f-bad3-4a2a0ff09740 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:17.525579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58dba9-d812-449f-bad3-4a2a0ff09740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:17.552418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dc58dba9-d812-449f-bad3-4a2a0ff09740 None None] MFA Rules not processed for user `2f7a707aedac4e81ad6df015a2a22392`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:17.553628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc58dba9-d812-449f-bad3-4a2a0ff09740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:17.618680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1146/2267] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:17.623614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:17.641501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:17.687949 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c162-e02f-4ea8-9dd5-84008c83d477 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:17.693117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:17.693794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:17.694083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:17.694365 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:17.695137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:17.697294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:17.826368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1122/2268] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:17 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:17.828931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58dba9-d812-449f-bad3-4a2a0ff09740 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:17.839671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58dba9-d812-449f-bad3-4a2a0ff09740 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:17.898005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:17.898593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:17.898910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:17.899195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:17.899902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:17.901811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:17.998441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1147/2269] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:17 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:17.999780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:18.010315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b467-e41d-4ca7-b327-27a951406eaa admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:18.015515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:18.016211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:18.016500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:18.016806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:18.017843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:18.019155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:18.030608 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1123/2270] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:18.034609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:18.046212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172f01-4063-41ff-9698-aec5ef4b4a0e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:18.051075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:18.051967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:18.052247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:18.052523 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] PATH_INFO: `/v3/projects/cbe93c1def0e498cb74b4845c23c27c5/users/d7a5d81b32e74fdb94b8e5d4c6e6385a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:18.068903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe93c1def0e498cb74b4845c23c27c5, user_id=d7a5d81b32e74fdb94b8e5d4c6e6385a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:18.071979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:18.148776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1148/2271] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:18 2022] PUT /identity/v3/projects/cbe93c1def0e498cb74b4845c23c27c5/users/d7a5d81b32e74fdb94b8e5d4c6e6385a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:18.152668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:18.163922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e287-b31a-403e-870e-c3af8c3eae06 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:18.220548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b91625-b47e-40d0-b055-15d471944eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:18.221362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b91625-b47e-40d0-b055-15d471944eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:18.221645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b91625-b47e-40d0-b055-15d471944eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:18.221921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b91625-b47e-40d0-b055-15d471944eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:18.222668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b91625-b47e-40d0-b055-15d471944eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:18.224270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b91625-b47e-40d0-b055-15d471944eaa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:18.234519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1124/2272] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:18.238603 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:18.249757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6908-bb71-4533-985a-a5b7ffffacb8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:18.254365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:18.255280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:18.255563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:18.255841 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] PATH_INFO: `/v3/projects/cbe93c1def0e498cb74b4845c23c27c5/users/d7a5d81b32e74fdb94b8e5d4c6e6385a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:18.257810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe93c1def0e498cb74b4845c23c27c5, user_id=d7a5d81b32e74fdb94b8e5d4c6e6385a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:18.260479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:18.266769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:18.271163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1149/2273] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:18 2022] PUT /identity/v3/projects/cbe93c1def0e498cb74b4845c23c27c5/users/d7a5d81b32e74fdb94b8e5d4c6e6385a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:18.281727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b0d6c-db86-494b-9a09-7a19a7cb0016 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:18.282087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b0d6c-db86-494b-9a09-7a19a7cb0016 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:18.282374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b0d6c-db86-494b-9a09-7a19a7cb0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:18.312260 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-519b0d6c-db86-494b-9a09-7a19a7cb0016 None None] MFA Rules not processed for user `d7a5d81b32e74fdb94b8e5d4c6e6385a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:18.313505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-519b0d6c-db86-494b-9a09-7a19a7cb0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:18.385970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1125/2274] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:38:18.397794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:18.403922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:18.471064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9273d-1b8f-4fc0-b371-b1cee94e4a07 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:18.474809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:18.475460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:18.475763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:18.476068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:18.486274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:18.487763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:18.499247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1150/2275] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:18.698196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b0d6c-db86-494b-9a09-7a19a7cb0016 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:18.708425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b0d6c-db86-494b-9a09-7a19a7cb0016 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:18.711997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46852404-8626-4fab-aed7-6902fb23063a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:18.712641 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46852404-8626-4fab-aed7-6902fb23063a service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:18.712955 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46852404-8626-4fab-aed7-6902fb23063a service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:18.713232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46852404-8626-4fab-aed7-6902fb23063a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:18.723592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:18.772426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46852404-8626-4fab-aed7-6902fb23063a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:18.773859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46852404-8626-4fab-aed7-6902fb23063a service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:18.783293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1126/2276] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:28.494436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=26 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:28.817214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=23 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:30.089619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:30.155277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11e71-c8b7-47cc-a811-95a111fa91e7 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:30.160376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:30.161259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:30.161545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:30.161819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] PATH_INFO: `/v3/users/2f7a707aedac4e81ad6df015a2a22392` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:30.163059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7a707aedac4e81ad6df015a2a22392)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:30.165343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:30.356310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7a707aedac4e81ad6df015a2a22392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:30.370338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7a707aedac4e81ad6df015a2a22392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:30.451189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7a707aedac4e81ad6df015a2a22392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:30.451903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7a707aedac4e81ad6df015a2a22392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:30.452537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7a707aedac4e81ad6df015a2a22392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:30.465590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1151/2277] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:30 2022] DELETE /identity/v3/users/2f7a707aedac4e81ad6df015a2a22392 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:30.471273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:30.471813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:30.471914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:30.494493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:30.494493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:30.564110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1127/2278] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:30.573462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:30.575223 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:30.635995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f0d8-8731-4a9d-a305-dcb14a17bbb4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:30.640285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:30.640927 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:30.641207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:30.641482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:30.650674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:30.652134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:30.662925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1152/2279] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:31.153745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:31.155156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:31.167301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c1466-5114-4f9e-9ff4-e5708164c2a2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:31.172289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:31.172768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:31.173047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:31.173317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] PATH_INFO: `/v3/projects/d1e532506150434aa610356d0e643dc6` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:31.174507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e532506150434aa610356d0e643dc6)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:31.176489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:31.293220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e532506150434aa610356d0e643dc6', 'request_id': 'req-4bcff7c5-4d8c-4243-801a-ffa8269f4894'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.299694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e532506150434aa610356d0e643dc6', 'request_id': 'req-4bcff7c5-4d8c-4243-801a-ffa8269f4894'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.306415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e532506150434aa610356d0e643dc6', 'request_id': 'req-4bcff7c5-4d8c-4243-801a-ffa8269f4894'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.368133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] The token cache is being invalidate because project d1e532506150434aa610356d0e643dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:31.368473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.369212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.380622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1128/2280] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:31 2022] DELETE /identity/v3/projects/d1e532506150434aa610356d0e643dc6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:31.380839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:31.395933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d66d7-8dec-4ca7-92a8-ef0dba8bdd6d service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:31.432473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:31.475941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:31.476861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:31.477280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:31.477568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] PATH_INFO: `/v3/users/d7a5d81b32e74fdb94b8e5d4c6e6385a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:31.478875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a5d81b32e74fdb94b8e5d4c6e6385a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:31.480895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:31.791282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a5d81b32e74fdb94b8e5d4c6e6385a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.806683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a5d81b32e74fdb94b8e5d4c6e6385a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.951942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a5d81b32e74fdb94b8e5d4c6e6385a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.953894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a5d81b32e74fdb94b8e5d4c6e6385a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.955913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-808da43a-98a5-4ee2-b288-dc3b22b9c0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a5d81b32e74fdb94b8e5d4c6e6385a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:31.976786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1153/2281] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:31 2022] DELETE /identity/v3/users/d7a5d81b32e74fdb94b8e5d4c6e6385a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:32.595656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:32.597107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:32.611020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcff7c5-4d8c-4243-801a-ffa8269f4894 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:32.676348 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:32.677234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:32.677522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:32.677799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] PATH_INFO: `/v3/projects/cbe93c1def0e498cb74b4845c23c27c5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:32.679049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe93c1def0e498cb74b4845c23c27c5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:32.681142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:32.801534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:32.819320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe93c1def0e498cb74b4845c23c27c5', 'request_id': 'req-14b347d7-81f8-4b76-9dd6-fd57791a2f00'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:32.828415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe93c1def0e498cb74b4845c23c27c5', 'request_id': 'req-14b347d7-81f8-4b76-9dd6-fd57791a2f00'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:32.835850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe93c1def0e498cb74b4845c23c27c5', 'request_id': 'req-14b347d7-81f8-4b76-9dd6-fd57791a2f00'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:32.926169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] The token cache is being invalidate because project cbe93c1def0e498cb74b4845c23c27c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:32.926465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:32.927123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14b347d7-81f8-4b76-9dd6-fd57791a2f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:32.928728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1129/2282] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:32 2022] DELETE /identity/v3/projects/cbe93c1def0e498cb74b4845c23c27c5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:32.933620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d123-97e2-4d38-9661-4fbd162fddb7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:32.934094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d123-97e2-4d38-9661-4fbd162fddb7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:32.934179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d123-97e2-4d38-9661-4fbd162fddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:32.953541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d807d123-97e2-4d38-9661-4fbd162fddb7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:32.958506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d807d123-97e2-4d38-9661-4fbd162fddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:33.018290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1154/2283] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:38:33.027457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08045ecc-0211-4722-9f85-703832d5ad69 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.027679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08045ecc-0211-4722-9f85-703832d5ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.027964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08045ecc-0211-4722-9f85-703832d5ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.048066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-08045ecc-0211-4722-9f85-703832d5ad69 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:33.049319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-08045ecc-0211-4722-9f85-703832d5ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:33.057604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1130/2284] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:33.061946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d123-97e2-4d38-9661-4fbd162fddb7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:33.071855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d123-97e2-4d38-9661-4fbd162fddb7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:33.077820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:33.078543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.078855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.079137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.079913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:33.080224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:33.081867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:33.094864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1155/2285] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:38:33.099003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08045ecc-0211-4722-9f85-703832d5ad69 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:33.108894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08045ecc-0211-4722-9f85-703832d5ad69 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:33.113853 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:33.114516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.114834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.115120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.116327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:33.117739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:33.238414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1131/2286] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:33 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:33.240833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:33.251330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b283e2-248f-45ac-9fc2-d53ffc16840f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:33.279637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:33.311190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:33.311993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.312283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.312567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.313300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:33.315375 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:33.411915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1156/2287] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:33 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:33.416175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:33.433065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54824e48-a261-4191-bed6-6d8b9f5caa5b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:33.438623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:33.439328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.439617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.439896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.440635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:33.442228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:33.453475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1132/2288] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:33.457350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:33.467711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316b6b-f73b-4446-8917-a80e1584974b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:33.472362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b4ade-a322-4da7-81cf-0eeb449cf650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:33.473025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b4ade-a322-4da7-81cf-0eeb449cf650 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.482956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b4ade-a322-4da7-81cf-0eeb449cf650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.482956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b4ade-a322-4da7-81cf-0eeb449cf650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.482956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b4ade-a322-4da7-81cf-0eeb449cf650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:33.482956 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b4ade-a322-4da7-81cf-0eeb449cf650 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:33.489850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1157/2289] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:33.491059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:33.502414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f1b8-3a28-42d5-9b03-e1b3594cb0a8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:33.508963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:33.509876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.510161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.510445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] PATH_INFO: `/v3/projects/92c648a056504b5982667f14a839fad6/users/a4b5131b05ad4b3ca102073618d929cf/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.545950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c648a056504b5982667f14a839fad6, user_id=a4b5131b05ad4b3ca102073618d929cf, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:33.549022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:33.760187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1133/2290] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:33 2022] PUT /identity/v3/projects/92c648a056504b5982667f14a839fad6/users/a4b5131b05ad4b3ca102073618d929cf/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:33.762099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb72e-3847-410c-a321-125e17fdd2f2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.762474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb72e-3847-410c-a321-125e17fdd2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.762894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bb72e-3847-410c-a321-125e17fdd2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.801940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-805bb72e-3847-410c-a321-125e17fdd2f2 None None] MFA Rules not processed for user `a4b5131b05ad4b3ca102073618d929cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:33.803189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-805bb72e-3847-410c-a321-125e17fdd2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:33.870931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1158/2291] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:38:33.876386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:33.959636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a3dc9-fee3-4e59-83c9-85d2c30e7225 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:33.965069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:33.965794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:33.966216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:33.966770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:33.967484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:33.969569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.126351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1134/2292] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:33 2022] POST /identity/v3/projects => generated 365 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:34.127213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bb72e-3847-410c-a321-125e17fdd2f2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:34.139798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bb72e-3847-410c-a321-125e17fdd2f2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:34.201673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:34.202351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.202632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.202932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.203636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:34.205551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.320464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1159/2293] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:34 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:38:34.323434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:34.334061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63646d21-07a2-4bd9-9d58-0f4a1d23405e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:34.338659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:34.339471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.339752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.340023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.341436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:34.343068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.354803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1135/2294] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:34.359670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:34.370105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67dca-e6b4-4e21-9d32-25e41be98216 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:34.375328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:34.376220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.376506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.376811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] PATH_INFO: `/v3/projects/bce44c5ed7d0468f9737490a64f32a41/users/55eec692bdf0455287de7d8bd8cb9ed0/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.391882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce44c5ed7d0468f9737490a64f32a41, user_id=55eec692bdf0455287de7d8bd8cb9ed0, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:34.394541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.486623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1160/2295] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:34 2022] PUT /identity/v3/projects/bce44c5ed7d0468f9737490a64f32a41/users/55eec692bdf0455287de7d8bd8cb9ed0/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:34.490664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:34.501596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d927e0-64de-4a6c-93eb-eb3cdd31929b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:34.523649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:34.563119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee4a6-acb1-4b30-8138-25c8c16976fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:34.563799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee4a6-acb1-4b30-8138-25c8c16976fc admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.564088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee4a6-acb1-4b30-8138-25c8c16976fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.564358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee4a6-acb1-4b30-8138-25c8c16976fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.565312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee4a6-acb1-4b30-8138-25c8c16976fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:34.566961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee4a6-acb1-4b30-8138-25c8c16976fc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.578005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1136/2296] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:34.583330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:34.590101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:34.597832 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a631d-cfb4-401b-9430-ec69468f0e37 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:34.603495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:34.626915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.626915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.626915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] PATH_INFO: `/v3/projects/bce44c5ed7d0468f9737490a64f32a41/users/55eec692bdf0455287de7d8bd8cb9ed0/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.626915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce44c5ed7d0468f9737490a64f32a41, user_id=55eec692bdf0455287de7d8bd8cb9ed0, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:34.626915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.627655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1161/2297] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:34 2022] PUT /identity/v3/projects/bce44c5ed7d0468f9737490a64f32a41/users/55eec692bdf0455287de7d8bd8cb9ed0/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:34.636736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4acae7-7661-4de7-b12e-e67deac94892 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.637052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4acae7-7661-4de7-b12e-e67deac94892 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.637335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4acae7-7661-4de7-b12e-e67deac94892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.663813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5f4acae7-7661-4de7-b12e-e67deac94892 None None] MFA Rules not processed for user `55eec692bdf0455287de7d8bd8cb9ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:34.665023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5f4acae7-7661-4de7-b12e-e67deac94892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:34.732758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1137/2298] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:34.744122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:34.745866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:34.806808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae3dd9-b10c-40ca-b2f0-b6022e64df09 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:34.811876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:34.812525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:34.812809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:34.813085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:34.822762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:34.824209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:34.833916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1162/2299] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:35.083514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4acae7-7661-4de7-b12e-e67deac94892 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:35.094020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4acae7-7661-4de7-b12e-e67deac94892 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:35.097819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482828-bf20-400b-89fc-9cedfb5a45d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:35.098584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482828-bf20-400b-89fc-9cedfb5a45d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:35.103096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482828-bf20-400b-89fc-9cedfb5a45d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:35.103096 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482828-bf20-400b-89fc-9cedfb5a45d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:35.165408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42482828-bf20-400b-89fc-9cedfb5a45d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:35.166879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42482828-bf20-400b-89fc-9cedfb5a45d8 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:35.177325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1138/2300] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:38.993910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:39.079507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f7d6a-f60d-4580-b67a-599d5d684691 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:39.086818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:39.087929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:39.088283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:39.088629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] PATH_INFO: `/v3/users/a4b5131b05ad4b3ca102073618d929cf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:39.090022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b5131b05ad4b3ca102073618d929cf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:39.092510 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:39.357640 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b5131b05ad4b3ca102073618d929cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:39.370247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b5131b05ad4b3ca102073618d929cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:39.502405 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b5131b05ad4b3ca102073618d929cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:39.503072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b5131b05ad4b3ca102073618d929cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:39.503690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b5131b05ad4b3ca102073618d929cf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:39.517334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1163/2301] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:38 2022] DELETE /identity/v3/users/a4b5131b05ad4b3ca102073618d929cf => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:39.521826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:39.522299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:39.522619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:39.541153 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:39.542429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:39.583577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:39.604648 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1139/2302] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:39.623876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:39.625397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:39.639109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:39.708298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457b57b-2040-457a-b616-1caeeec34670 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:39.713166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:39.713826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:39.714112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:39.714391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:39.725976 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:39.727458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:39.737465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1164/2303] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:40.356430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:40.359335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:40.375049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cde18-5160-4b45-93ce-ae5eb626368e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:40.380373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:40.381439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:40.381787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:40.382145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] PATH_INFO: `/v3/projects/92c648a056504b5982667f14a839fad6` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:40.383522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c648a056504b5982667f14a839fad6)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:40.386498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:40.550529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c648a056504b5982667f14a839fad6', 'request_id': 'req-a773ee3a-9846-482e-ba1e-54f413ec7c1c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:40.555944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c648a056504b5982667f14a839fad6', 'request_id': 'req-a773ee3a-9846-482e-ba1e-54f413ec7c1c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:40.562107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c648a056504b5982667f14a839fad6', 'request_id': 'req-a773ee3a-9846-482e-ba1e-54f413ec7c1c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:40.705712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] The token cache is being invalidate because project 92c648a056504b5982667f14a839fad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:40.705712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:40.705712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:40.705712 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1140/2304] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:40 2022] DELETE /identity/v3/projects/92c648a056504b5982667f14a839fad6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:40.706174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:40.713631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd16df-ba07-4e60-b52c-2a36e311204d service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:40.770783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:40.771665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:40.771951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:40.772228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] PATH_INFO: `/v3/users/55eec692bdf0455287de7d8bd8cb9ed0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:40.773437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55eec692bdf0455287de7d8bd8cb9ed0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:40.775416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:41.070913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55eec692bdf0455287de7d8bd8cb9ed0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:41.083604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55eec692bdf0455287de7d8bd8cb9ed0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:41.205064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55eec692bdf0455287de7d8bd8cb9ed0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:41.205708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55eec692bdf0455287de7d8bd8cb9ed0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:41.206318 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5eaab37b-a995-435e-af06-dd58e85705f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55eec692bdf0455287de7d8bd8cb9ed0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:41.218972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1165/2305] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:40 2022] DELETE /identity/v3/users/55eec692bdf0455287de7d8bd8cb9ed0 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:41.881584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:41.883271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:41.897266 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ee3a-9846-482e-ba1e-54f413ec7c1c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:41.961511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:41.962389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:41.962707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:41.963015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] PATH_INFO: `/v3/projects/bce44c5ed7d0468f9737490a64f32a41` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:41.964218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce44c5ed7d0468f9737490a64f32a41)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:41.967603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:42.109795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce44c5ed7d0468f9737490a64f32a41', 'request_id': 'req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:42.115467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce44c5ed7d0468f9737490a64f32a41', 'request_id': 'req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:42.121822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce44c5ed7d0468f9737490a64f32a41', 'request_id': 'req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:42.206810 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:42.211694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] The token cache is being invalidate because project bce44c5ed7d0468f9737490a64f32a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:42.211984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:42.212635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa7471b8-9fed-4a26-b95d-8562ac6cf5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:42.214247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1141/2306] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:41 2022] DELETE /identity/v3/projects/bce44c5ed7d0468f9737490a64f32a41 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:42.220436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63296f90-02c2-480e-b84a-db6c7189535a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.222450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63296f90-02c2-480e-b84a-db6c7189535a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.222450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63296f90-02c2-480e-b84a-db6c7189535a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.240862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63296f90-02c2-480e-b84a-db6c7189535a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:42.242327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63296f90-02c2-480e-b84a-db6c7189535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:42.252247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:42.305696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1166/2307] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:42.313964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b4270-10da-4a24-a877-7af0b35136cf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.314249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b4270-10da-4a24-a877-7af0b35136cf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.314534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b4270-10da-4a24-a877-7af0b35136cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.333209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6c5b4270-10da-4a24-a877-7af0b35136cf None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:42.334430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6c5b4270-10da-4a24-a877-7af0b35136cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:42.343250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1142/2308] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:42.347462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63296f90-02c2-480e-b84a-db6c7189535a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:42.357296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63296f90-02c2-480e-b84a-db6c7189535a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:42.362163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:42.362803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.363097 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.363385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.364215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:42.364666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:42.366319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:42.379526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1167/2309] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:38:42.384372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b4270-10da-4a24-a877-7af0b35136cf None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:42.394516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b4270-10da-4a24-a877-7af0b35136cf None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:42.399281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:42.399941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.400225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.400501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.401248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:42.403226 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:42.511024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1143/2310] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:42 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:38:42.517622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:42.527722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981164a-4a6e-4055-9bd2-b75aad4dc37c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:42.592781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:42.593500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.593782 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.594061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.594787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:42.596715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:42.704295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1168/2311] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:42 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:42.708598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:42.719213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129332-747b-4930-b1c5-484a5c56158d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:42.724080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:42.724734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.725020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.725302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.726033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:42.727735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:42.738617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1144/2312] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:42.742799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:42.753924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382fba7-c3b4-4ef2-95af-f42e8c0416e0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:42.759160 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c97fe2-784a-4624-83ed-4fb557cd01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:42.759828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c97fe2-784a-4624-83ed-4fb557cd01d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.760117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c97fe2-784a-4624-83ed-4fb557cd01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.760464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c97fe2-784a-4624-83ed-4fb557cd01d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.761131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c97fe2-784a-4624-83ed-4fb557cd01d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:42.762787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c97fe2-784a-4624-83ed-4fb557cd01d2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:42.776470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1169/2313] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:42.777598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:42.788844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10dc42-b3ff-4e87-8dc4-e920d604aec3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:42.793585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:42.795159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.795423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.795703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] PATH_INFO: `/v3/projects/45c50da225d342ab901676d109664ddd/users/d6600dd2d3db4f398eaacc014f032c62/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.811462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c50da225d342ab901676d109664ddd, user_id=d6600dd2d3db4f398eaacc014f032c62, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:42.814126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:42.948799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1145/2314] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:42 2022] PUT /identity/v3/projects/45c50da225d342ab901676d109664ddd/users/d6600dd2d3db4f398eaacc014f032c62/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:42.961635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33376917-d451-4252-ad1d-ce1d997e152c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:42.961635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33376917-d451-4252-ad1d-ce1d997e152c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:42.961635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33376917-d451-4252-ad1d-ce1d997e152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:42.986532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-33376917-d451-4252-ad1d-ce1d997e152c None None] MFA Rules not processed for user `d6600dd2d3db4f398eaacc014f032c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:42.987781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-33376917-d451-4252-ad1d-ce1d997e152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:43.052018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1170/2315] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:43.056592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:43.118614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0eb66e-98f2-4654-a6bc-dadd180004cf admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:43.123492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:43.124163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.124452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.124733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.125492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:43.127537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:43.247376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1146/2316] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:43 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:43.250938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33376917-d451-4252-ad1d-ce1d997e152c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:43.261750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33376917-d451-4252-ad1d-ce1d997e152c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:43.266372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:43.319933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:43.320641 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.320953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.321239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.322092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:43.324175 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:43.420059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1171/2317] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:43 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:43.421509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:43.432111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c3e07-aba7-4bc7-8067-2cc8d4e94af0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:43.437247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:43.437909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.438199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.438602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.439371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:43.441012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:43.453734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1147/2318] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:43.458129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:43.469432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148197cd-e7b4-4f60-ae12-fc63450eaf4a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:43.474092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:43.475016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.475307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.475584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] PATH_INFO: `/v3/projects/fad616a2145144898a2e2bc93d5913fa/users/321afaf50faa421a97341f62598363b1/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.490179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad616a2145144898a2e2bc93d5913fa, user_id=321afaf50faa421a97341f62598363b1, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:43.492870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:43.583596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1172/2319] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:43 2022] PUT /identity/v3/projects/fad616a2145144898a2e2bc93d5913fa/users/321afaf50faa421a97341f62598363b1/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:43.587613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:43.598952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72940944-ec0a-435e-afb7-7f54ef76a723 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:43.659854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96066d9e-6969-4a64-bcd2-f7af2ade0c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:43.660539 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066d9e-6969-4a64-bcd2-f7af2ade0c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.664073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066d9e-6969-4a64-bcd2-f7af2ade0c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.664073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066d9e-6969-4a64-bcd2-f7af2ade0c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.664073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96066d9e-6969-4a64-bcd2-f7af2ade0c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:43.664073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96066d9e-6969-4a64-bcd2-f7af2ade0c56 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:43.674635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1148/2320] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:38:43.678901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:43.690338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5484781-675c-4f4f-8414-7126f3515cda admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:43.695141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:43.696080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.696365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.696665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] PATH_INFO: `/v3/projects/fad616a2145144898a2e2bc93d5913fa/users/321afaf50faa421a97341f62598363b1/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.698845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad616a2145144898a2e2bc93d5913fa, user_id=321afaf50faa421a97341f62598363b1, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:43.702152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:43.722482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1173/2321] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:43 2022] PUT /identity/v3/projects/fad616a2145144898a2e2bc93d5913fa/users/321afaf50faa421a97341f62598363b1/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:43.726432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.726756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.727082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.734989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:43.754192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] MFA Rules not processed for user `321afaf50faa421a97341f62598363b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:43.755895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:43.822297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1149/2322] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:43.834189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:43.835949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:43.921082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28603d-46f5-4009-b6ae-6b796861f69c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:43.924776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:43.925421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:43.925705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:43.925980 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:43.935660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:43.942687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:43.947075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1174/2323] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:44.089736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:44.091247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:44.103329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bcbce-c6d8-4d67-9c23-984f83209508 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:44.107207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd71782-a2e3-4350-924e-3f0a027fc247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:44.107854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd71782-a2e3-4350-924e-3f0a027fc247 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:44.108208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd71782-a2e3-4350-924e-3f0a027fc247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:44.108498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd71782-a2e3-4350-924e-3f0a027fc247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:44.165823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd71782-a2e3-4350-924e-3f0a027fc247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:44.167407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd71782-a2e3-4350-924e-3f0a027fc247 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:44.176571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1150/2324] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:44.887437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:44.932842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:44.948977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a5e65-59a2-4f80-9704-94e4e7e7fc6b service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:44.954316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:44.955232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:44.955515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:44.955789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] PATH_INFO: `/v3/users/d6600dd2d3db4f398eaacc014f032c62` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:44.956988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6600dd2d3db4f398eaacc014f032c62)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:44.959129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:45.191888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6600dd2d3db4f398eaacc014f032c62'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:45.205309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6600dd2d3db4f398eaacc014f032c62'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:45.274217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6600dd2d3db4f398eaacc014f032c62'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:45.274963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6600dd2d3db4f398eaacc014f032c62'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:45.275706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6600dd2d3db4f398eaacc014f032c62'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:45.290144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1175/2325] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:44 2022] DELETE /identity/v3/users/d6600dd2d3db4f398eaacc014f032c62 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:45.295302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:45.295776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:45.295893 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:45.312936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:45.314119 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:45.380371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1151/2326] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:45.392072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:45.393725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:45.459255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500936-2379-4735-8391-0e6eac57d1f1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:45.463122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:45.463919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:45.464210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:45.464593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:45.475588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:45.482511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:45.488909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1176/2327] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:46.019180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:46.020634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:46.032804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255268a8-2c9e-40b1-a106-fd32c965e38e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:46.038008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:46.038311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:46.039037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:46.039195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] PATH_INFO: `/v3/projects/45c50da225d342ab901676d109664ddd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:46.040653 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c50da225d342ab901676d109664ddd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:46.042596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:46.068800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:46.224393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c50da225d342ab901676d109664ddd', 'request_id': 'req-e5e3e1c4-0208-4565-95a5-12f73560af83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.229880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c50da225d342ab901676d109664ddd', 'request_id': 'req-e5e3e1c4-0208-4565-95a5-12f73560af83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.236709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c50da225d342ab901676d109664ddd', 'request_id': 'req-e5e3e1c4-0208-4565-95a5-12f73560af83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.382635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] The token cache is being invalidate because project 45c50da225d342ab901676d109664ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:46.383244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.383602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.385387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1152/2328] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:46 2022] DELETE /identity/v3/projects/45c50da225d342ab901676d109664ddd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:38:46.389525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:46.399285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74578e5-8c13-4d7f-a663-d731e74b9454 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:46.471544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:46.472556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:46.472844 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:46.473133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] PATH_INFO: `/v3/users/321afaf50faa421a97341f62598363b1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:46.474384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321afaf50faa421a97341f62598363b1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:46.476375 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:46.483472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:46.756148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321afaf50faa421a97341f62598363b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.768328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321afaf50faa421a97341f62598363b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.914252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321afaf50faa421a97341f62598363b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.914912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321afaf50faa421a97341f62598363b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.915534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85a8a9c7-8c80-412d-9e7f-a54f3a6d6f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321afaf50faa421a97341f62598363b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:46.928481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1177/2329] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:46 2022] DELETE /identity/v3/users/321afaf50faa421a97341f62598363b1 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:47.494057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:47.495753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:47.518021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e1c4-0208-4565-95a5-12f73560af83 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:47.598240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:47.598936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:47.599300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:47.599621 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] PATH_INFO: `/v3/projects/fad616a2145144898a2e2bc93d5913fa` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:47.600946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad616a2145144898a2e2bc93d5913fa)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:47.602979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:47.725343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad616a2145144898a2e2bc93d5913fa', 'request_id': 'req-925dcca1-461a-4e2d-ac1d-9564eb91647c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:47.732826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad616a2145144898a2e2bc93d5913fa', 'request_id': 'req-925dcca1-461a-4e2d-ac1d-9564eb91647c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:47.743652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad616a2145144898a2e2bc93d5913fa', 'request_id': 'req-925dcca1-461a-4e2d-ac1d-9564eb91647c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:47.822782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] The token cache is being invalidate because project fad616a2145144898a2e2bc93d5913fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:47.823085 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:47.823796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-925dcca1-461a-4e2d-ac1d-9564eb91647c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:47.825710 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1153/2330] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:47 2022] DELETE /identity/v3/projects/fad616a2145144898a2e2bc93d5913fa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:47.831004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b316d3-9a4b-4562-ac47-b520c1380041 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:47.831493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b316d3-9a4b-4562-ac47-b520c1380041 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:47.831811 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b316d3-9a4b-4562-ac47-b520c1380041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:47.850476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e1b316d3-9a4b-4562-ac47-b520c1380041 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:47.851796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1b316d3-9a4b-4562-ac47-b520c1380041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:47.914628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1178/2331] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:47.923274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000009af-fb22-4a15-9d74-c11def32b393 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:47.923656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000009af-fb22-4a15-9d74-c11def32b393 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:47.923836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000009af-fb22-4a15-9d74-c11def32b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:47.942446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-000009af-fb22-4a15-9d74-c11def32b393 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:47.943678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-000009af-fb22-4a15-9d74-c11def32b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:47.952601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1154/2332] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:47.956876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b316d3-9a4b-4562-ac47-b520c1380041 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:47.974658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b316d3-9a4b-4562-ac47-b520c1380041 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:47.974658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:47.974658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:47.974658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:47.975069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:47.975069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:47.975069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:47.975511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:47.987066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1179/2333] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:38:47.991290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000009af-fb22-4a15-9d74-c11def32b393 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:48.000777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000009af-fb22-4a15-9d74-c11def32b393 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:48.005431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:48.006068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.006347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.006618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.007378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:48.009282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:48.099686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1155/2334] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:47 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:48.103278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:48.113887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1204d-8d68-44ce-b42c-69c1139a8814 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:48.176485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:48.177013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.177298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.177578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.178289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:48.180719 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:48.287176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1180/2335] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:48 2022] POST /identity/v3/users => generated 281 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:48.291934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:48.302355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069bfc7-245f-4942-b685-35d162c68643 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:48.306984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:48.307638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.307922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.308202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.308928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:48.310794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:48.321181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1156/2336] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:48.326480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:48.331718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:48.336942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708799-611f-48ab-9745-09693810fddb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:48.342859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546be7e0-112d-46f5-8617-624040f316ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:48.343511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be7e0-112d-46f5-8617-624040f316ac admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.343794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be7e0-112d-46f5-8617-624040f316ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.344070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be7e0-112d-46f5-8617-624040f316ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.344789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546be7e0-112d-46f5-8617-624040f316ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:48.346399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546be7e0-112d-46f5-8617-624040f316ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:48.357378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1181/2337] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:48.361629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:48.366697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:48.372979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3086f-df9c-4ba6-a340-0ab16e0cb98d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:48.377970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:48.378920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.379209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.379487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] PATH_INFO: `/v3/projects/d5aa84e418854fb3b58546c231916d02/users/d1f1791432f64fbf89bb6b487f00d90e/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.394634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5aa84e418854fb3b58546c231916d02, user_id=d1f1791432f64fbf89bb6b487f00d90e, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:48.397317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:48.588450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1157/2338] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:48 2022] PUT /identity/v3/projects/d5aa84e418854fb3b58546c231916d02/users/d1f1791432f64fbf89bb6b487f00d90e/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:48.598917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c38a-463d-456c-a6b4-d2d62a5223c4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.599212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c38a-463d-456c-a6b4-d2d62a5223c4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.599492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c38a-463d-456c-a6b4-d2d62a5223c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.627151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5518c38a-463d-456c-a6b4-d2d62a5223c4 None None] MFA Rules not processed for user `d1f1791432f64fbf89bb6b487f00d90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:48.628347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5518c38a-463d-456c-a6b4-d2d62a5223c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:48.691651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1182/2339] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:48.730459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:48.733080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:48.792614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd64fb9-ea54-44b4-ba82-fa39c91e1d08 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:48.797107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac292-1f5b-449b-8008-f447d35c7a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:48.797768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac292-1f5b-449b-8008-f447d35c7a77 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.798136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac292-1f5b-449b-8008-f447d35c7a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.798423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac292-1f5b-449b-8008-f447d35c7a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.807157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ac292-1f5b-449b-8008-f447d35c7a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:48.810355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ac292-1f5b-449b-8008-f447d35c7a77 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:48.819177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1158/2340] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:48.833734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518c38a-463d-456c-a6b4-d2d62a5223c4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:48.897987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518c38a-463d-456c-a6b4-d2d62a5223c4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:48.902725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:48.903652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:48.903951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:48.904233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] PATH_INFO: `/v3/users/d1f1791432f64fbf89bb6b487f00d90e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:48.905857 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f1791432f64fbf89bb6b487f00d90e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:48.907868 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:49.116198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f1791432f64fbf89bb6b487f00d90e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:49.127938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f1791432f64fbf89bb6b487f00d90e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:49.241708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f1791432f64fbf89bb6b487f00d90e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:49.242338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f1791432f64fbf89bb6b487f00d90e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:49.242979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f1791432f64fbf89bb6b487f00d90e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:49.255756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1183/2341] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:38:48 2022] DELETE /identity/v3/users/d1f1791432f64fbf89bb6b487f00d90e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:49.260201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:49.260521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:49.260802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:49.279920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:49.281162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:49.338994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1159/2342] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:49.349215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:49.350797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:49.408882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d563e-51ad-424d-a833-eefef68aa69a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:49.412574 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774558ad-b4d5-4206-a7dd-1f1746128c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:49.413253 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774558ad-b4d5-4206-a7dd-1f1746128c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:49.413542 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774558ad-b4d5-4206-a7dd-1f1746128c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:49.414119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774558ad-b4d5-4206-a7dd-1f1746128c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:49.423928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774558ad-b4d5-4206-a7dd-1f1746128c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:49.425359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774558ad-b4d5-4206-a7dd-1f1746128c7b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:49.435534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1184/2343] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:38:49.628815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:49.859715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:49.861325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:49.875672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2a2f-93d7-4a62-9492-a8cfea16169c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:49.881237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:49.882213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:49.882538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:49.883017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] PATH_INFO: `/v3/projects/d5aa84e418854fb3b58546c231916d02` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:49.884592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5aa84e418854fb3b58546c231916d02)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:49.886951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:50.063912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5aa84e418854fb3b58546c231916d02', 'request_id': 'req-27298543-b4f5-4592-a0da-00be9511704a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:50.069449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5aa84e418854fb3b58546c231916d02', 'request_id': 'req-27298543-b4f5-4592-a0da-00be9511704a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:50.076471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5aa84e418854fb3b58546c231916d02', 'request_id': 'req-27298543-b4f5-4592-a0da-00be9511704a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:50.226400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] The token cache is being invalidate because project d5aa84e418854fb3b58546c231916d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:38:50.226676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:50.227304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27298543-b4f5-4592-a0da-00be9511704a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:38:50.228892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1160/2344] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:38:49 2022] DELETE /identity/v3/projects/d5aa84e418854fb3b58546c231916d02 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:50.234243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0268-3f06-41fc-bd08-6dbfddd27118 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.234785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0268-3f06-41fc-bd08-6dbfddd27118 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.234885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c0268-3f06-41fc-bd08-6dbfddd27118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.259152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-502c0268-3f06-41fc-bd08-6dbfddd27118 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:50.259152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-502c0268-3f06-41fc-bd08-6dbfddd27118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:50.318657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1185/2345] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:50.327842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde3074-3b6e-4c57-8b86-34ad3ce6ecd8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.328162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde3074-3b6e-4c57-8b86-34ad3ce6ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.328444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde3074-3b6e-4c57-8b86-34ad3ce6ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.336055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:50.347035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8dde3074-3b6e-4c57-8b86-34ad3ce6ecd8 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:50.348332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8dde3074-3b6e-4c57-8b86-34ad3ce6ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:50.357404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1161/2346] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:50.365132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0268-3f06-41fc-bd08-6dbfddd27118 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:50.375622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c0268-3f06-41fc-bd08-6dbfddd27118 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:50.380307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:50.380963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.381250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.381525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.382291 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:38:50.382625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:50.384258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:50.400614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1186/2347] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:38:50.401666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde3074-3b6e-4c57-8b86-34ad3ce6ecd8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:50.411314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde3074-3b6e-4c57-8b86-34ad3ce6ecd8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:50.417055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:50.418129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.418477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.419340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.420275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:50.422431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:50.532600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1162/2348] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:38:50 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:50.538467 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:50.549748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f604d15-5b8d-404e-b7ae-c6a5ab06afa9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:50.607724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:50.608389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.608680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.608963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.609650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:50.611607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:50.760651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1187/2349] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:38:50 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:38:50.764905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:50.775222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26a7f-5483-491d-a278-0e00d32e9cd4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:50.780432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:50.781107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.781407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.781974 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.782929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:50.784919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:50.797385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1163/2350] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:50.801390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:50.811658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac41cad-be95-426e-b500-c17e8fac6977 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:50.816504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c492-d531-4e46-b4be-4fbb17d6fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:50.817204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c492-d531-4e46-b4be-4fbb17d6fa46 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.817783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c492-d531-4e46-b4be-4fbb17d6fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.818074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c492-d531-4e46-b4be-4fbb17d6fa46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.818846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347c492-d531-4e46-b4be-4fbb17d6fa46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:50.820614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347c492-d531-4e46-b4be-4fbb17d6fa46 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:50.830786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1188/2351] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:38:50.835021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:50.845550 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23002d-d3e2-495f-9159-18be119f512d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:50.850117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:50.851023 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:50.851312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:50.851592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] PATH_INFO: `/v3/projects/87231b2b0aae4d0a894583e98833767f/users/3f7a854215d14e51a26543aa50cd5c85/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:50.866668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87231b2b0aae4d0a894583e98833767f, user_id=3f7a854215d14e51a26543aa50cd5c85, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:50.869334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:51.005668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1164/2352] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:38:50 2022] PUT /identity/v3/projects/87231b2b0aae4d0a894583e98833767f/users/3f7a854215d14e51a26543aa50cd5c85/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:38:51.017313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:51.017575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:51.017873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:51.037865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:51.047178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] MFA Rules not processed for user `3f7a854215d14e51a26543aa50cd5c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:38:51.048436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:51.123242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1189/2353] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:38:51.135082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:38:51.140076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:38:51.196890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d1e3-c27c-42c5-8356-6570508d65d3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:38:51.201324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:38:51.201971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:38:51.203077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:38:51.203077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:38:51.212925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:38:51.214436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:38:51.224224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1165/2354] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:01.220079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:01.302370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=28 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:03.408601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:03.410228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:03.476930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c435e-e665-4d11-8d61-edce9e91bfd5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:03.481996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:03.482909 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:03.483197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:03.483505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] PATH_INFO: `/v3/users/0eb00d281e64435f9bf050eef54f9766` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:03.484727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb00d281e64435f9bf050eef54f9766)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:03.486633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:03.791481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb00d281e64435f9bf050eef54f9766'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.804673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb00d281e64435f9bf050eef54f9766'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.907396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb00d281e64435f9bf050eef54f9766'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.908024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb00d281e64435f9bf050eef54f9766'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.908636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb00d281e64435f9bf050eef54f9766'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:03.922597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1190/2355] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:03 2022] DELETE /identity/v3/users/0eb00d281e64435f9bf050eef54f9766 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:04.235925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:04.248689 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a6be6-5465-43de-b515-6c845c5ef4c4 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:04.325206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:04.326077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:04.326419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:04.326699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] PATH_INFO: `/v3/projects/d5339dd041954c53b5904ab86091931a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:04.327989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5339dd041954c53b5904ab86091931a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:04.330013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:04.471571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5339dd041954c53b5904ab86091931a', 'request_id': 'req-c38da040-a019-4703-a995-695ffcf27082'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.477586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5339dd041954c53b5904ab86091931a', 'request_id': 'req-c38da040-a019-4703-a995-695ffcf27082'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.487636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5339dd041954c53b5904ab86091931a', 'request_id': 'req-c38da040-a019-4703-a995-695ffcf27082'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.576713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] The token cache is being invalidate because project d5339dd041954c53b5904ab86091931a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:04.577012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.577680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c38da040-a019-4703-a995-695ffcf27082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:04.579259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1166/2356] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:04 2022] DELETE /identity/v3/projects/d5339dd041954c53b5904ab86091931a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:39:13.918796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:13.972037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:13.973519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:13.987462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beafdb9-4b50-4672-8797-1b60f8c4aa63 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:14.046693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:14.047588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:14.047871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:14.048150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] PATH_INFO: `/v3/users/3f7a854215d14e51a26543aa50cd5c85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:14.049530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7a854215d14e51a26543aa50cd5c85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:14.051479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:14.339154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7a854215d14e51a26543aa50cd5c85'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.351505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7a854215d14e51a26543aa50cd5c85'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.491051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7a854215d14e51a26543aa50cd5c85'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.491683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7a854215d14e51a26543aa50cd5c85'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.492298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7a854215d14e51a26543aa50cd5c85'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:14.505316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1191/2357] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:13 2022] DELETE /identity/v3/users/3f7a854215d14e51a26543aa50cd5c85 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:14.509886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:14.510402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:14.510519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:14.528728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:14.530848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:14.590422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1167/2358] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:14.604074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:14.605400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:14.663971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd0a02-406c-4c0d-a763-5c3ba1672780 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:14.667855 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f8f5a-6dce-46df-924b-58bcf2a1d05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:14.668493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8f5a-6dce-46df-924b-58bcf2a1d05c service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:14.668773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8f5a-6dce-46df-924b-58bcf2a1d05c service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:14.669045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8f5a-6dce-46df-924b-58bcf2a1d05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:14.679378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f8f5a-6dce-46df-924b-58bcf2a1d05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:14.680827 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f8f5a-6dce-46df-924b-58bcf2a1d05c service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:14.691331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1192/2359] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:15.137920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:15.139968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:15.153123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0e79b-ad8e-4262-a38b-33c9a710302b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:15.160017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:15.160894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.161182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.161459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] PATH_INFO: `/v3/projects/87231b2b0aae4d0a894583e98833767f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.162671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87231b2b0aae4d0a894583e98833767f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:15.175139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:15.371722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:15.387966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87231b2b0aae4d0a894583e98833767f', 'request_id': 'req-2499e53a-d9bb-4865-bac1-110fc01f1e8f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:15.394238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87231b2b0aae4d0a894583e98833767f', 'request_id': 'req-2499e53a-d9bb-4865-bac1-110fc01f1e8f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:15.400453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87231b2b0aae4d0a894583e98833767f', 'request_id': 'req-2499e53a-d9bb-4865-bac1-110fc01f1e8f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:15.592847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] The token cache is being invalidate because project 87231b2b0aae4d0a894583e98833767f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:15.593663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:15.593836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2499e53a-d9bb-4865-bac1-110fc01f1e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:15.595499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1168/2360] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:15 2022] DELETE /identity/v3/projects/87231b2b0aae4d0a894583e98833767f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:15.600679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7618ec7-4a3b-408c-953b-0e36277b3604 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.601130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7618ec7-4a3b-408c-953b-0e36277b3604 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.601269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7618ec7-4a3b-408c-953b-0e36277b3604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.619726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f7618ec7-4a3b-408c-953b-0e36277b3604 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:15.621007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7618ec7-4a3b-408c-953b-0e36277b3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:15.649861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:15.680776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1193/2361] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:15.690723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a007664-63e2-4e62-bc91-627bdcce0760 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.691042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a007664-63e2-4e62-bc91-627bdcce0760 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.691328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a007664-63e2-4e62-bc91-627bdcce0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.710095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4a007664-63e2-4e62-bc91-627bdcce0760 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:15.711391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4a007664-63e2-4e62-bc91-627bdcce0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:15.719538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1169/2362] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:15.723854 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7618ec7-4a3b-408c-953b-0e36277b3604 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:15.734349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7618ec7-4a3b-408c-953b-0e36277b3604 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:15.739297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:15.739951 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.740238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.740518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.741249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:15.741593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:15.743242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:15.755460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1194/2363] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:39:15.759798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a007664-63e2-4e62-bc91-627bdcce0760 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:15.769405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a007664-63e2-4e62-bc91-627bdcce0760 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:15.774136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:15.774824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.775110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.775387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.776120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:15.778084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:15.875715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1170/2364] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:15 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:15.880008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:15.889919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179d7aa-76a1-4152-b526-cc8dffda90e0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:15.946432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:15.947062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:15.947347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:15.947624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:15.948319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:15.950241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:16.063421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1195/2365] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:15 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:16.067566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:16.077991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542954a-e359-4408-8e40-9ef463e718a7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:16.082561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:16.083248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:16.083534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:16.083815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:16.084545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:16.086140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:16.097233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1171/2366] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:16.101199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:16.111847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729bf9e-5538-4ab5-a54b-425ecc1a518e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:16.126407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5b05b-b716-4e31-a256-40a48dced60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:16.126407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5b05b-b716-4e31-a256-40a48dced60b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:16.126407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5b05b-b716-4e31-a256-40a48dced60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:16.126407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5b05b-b716-4e31-a256-40a48dced60b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:16.126958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5b05b-b716-4e31-a256-40a48dced60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:16.126958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5b05b-b716-4e31-a256-40a48dced60b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:16.130268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1196/2367] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:16.134339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:16.144282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fc587-2a1e-4e37-804b-066587b7e0c8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:16.148944 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:16.149808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:16.150093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:16.150372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] PATH_INFO: `/v3/projects/57cd984a5bc64919ad8736caada826aa/users/4a1658b0c3b6497e9dc2208d2e0b4fa0/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:16.166015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cd984a5bc64919ad8736caada826aa, user_id=4a1658b0c3b6497e9dc2208d2e0b4fa0, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:16.168711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:16.287132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1172/2368] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:16 2022] PUT /identity/v3/projects/57cd984a5bc64919ad8736caada826aa/users/4a1658b0c3b6497e9dc2208d2e0b4fa0/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:16.355374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:16.355661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:16.355940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:16.386600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] MFA Rules not processed for user `4a1658b0c3b6497e9dc2208d2e0b4fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:16.388131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:16.464606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1197/2369] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:16.476556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:16.484221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:16.550175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44238b-5900-4edf-92e5-65d0969a4036 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:16.553803 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:16.554453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:16.554770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:16.555046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:16.565694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:16.567167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:16.577397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1173/2370] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:17.680268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:17.681673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.705767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:17.776869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643dcac-f60d-46c2-a694-16506cf803e2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:17.783003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3518a-57db-447a-b53d-f88ba6b4cde1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:17.783661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3518a-57db-447a-b53d-f88ba6b4cde1 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:17.783946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3518a-57db-447a-b53d-f88ba6b4cde1 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:17.784246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3518a-57db-447a-b53d-f88ba6b4cde1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:17.786068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-29e3518a-57db-447a-b53d-f88ba6b4cde1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:17.798984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3518a-57db-447a-b53d-f88ba6b4cde1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:17.800602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3518a-57db-447a-b53d-f88ba6b4cde1 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:17.812114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1198/2371] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:21.959395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:22.011789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:22.023486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050ae09-5150-4ee7-b64b-526120100bd1 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:22.028022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:22.028917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.029204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.029509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] PATH_INFO: `/v3/users/4a1658b0c3b6497e9dc2208d2e0b4fa0` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.031497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1658b0c3b6497e9dc2208d2e0b4fa0)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:22.033421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.310785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1658b0c3b6497e9dc2208d2e0b4fa0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:22.323669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1658b0c3b6497e9dc2208d2e0b4fa0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:22.324357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1658b0c3b6497e9dc2208d2e0b4fa0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:22.416632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1658b0c3b6497e9dc2208d2e0b4fa0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:22.417623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1658b0c3b6497e9dc2208d2e0b4fa0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:22.431701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1174/2372] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:21 2022] DELETE /identity/v3/users/4a1658b0c3b6497e9dc2208d2e0b4fa0 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:22.437075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.437589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.437721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.455451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:22.456649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:22.516612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1199/2373] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:22.526889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:22.528296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:22.585797 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff8a2-802e-4a25-8f0c-232e9ca45696 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:22.589400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04dca7-5cc2-4737-a3c0-8a8220b1b644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:22.590047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04dca7-5cc2-4737-a3c0-8a8220b1b644 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:22.590356 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04dca7-5cc2-4737-a3c0-8a8220b1b644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:22.590633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04dca7-5cc2-4737-a3c0-8a8220b1b644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:22.600069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04dca7-5cc2-4737-a3c0-8a8220b1b644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:22.601511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04dca7-5cc2-4737-a3c0-8a8220b1b644 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:22.611500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1175/2374] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:23.271104 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:23.272699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:23.287202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e40812-98ff-49b0-85a2-04c2a0c1c1be None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:23.295621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:23.296950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.297741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.297971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] PATH_INFO: `/v3/projects/57cd984a5bc64919ad8736caada826aa` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.299817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cd984a5bc64919ad8736caada826aa)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:23.301957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:23.452834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cd984a5bc64919ad8736caada826aa', 'request_id': 'req-92412cfb-2553-44d3-80bc-a9fc62ddb24c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.531081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cd984a5bc64919ad8736caada826aa', 'request_id': 'req-92412cfb-2553-44d3-80bc-a9fc62ddb24c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.537347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cd984a5bc64919ad8736caada826aa', 'request_id': 'req-92412cfb-2553-44d3-80bc-a9fc62ddb24c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.549645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] The token cache is being invalidate because project 57cd984a5bc64919ad8736caada826aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:23.549943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.550622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-92412cfb-2553-44d3-80bc-a9fc62ddb24c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:23.552556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1200/2375] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:23 2022] DELETE /identity/v3/projects/57cd984a5bc64919ad8736caada826aa => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:23.557579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9e53-1df2-4bf5-89f3-2bfbe1879be1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.558082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9e53-1df2-4bf5-89f3-2bfbe1879be1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.558334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe9e53-1df2-4bf5-89f3-2bfbe1879be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.577746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1ffe9e53-1df2-4bf5-89f3-2bfbe1879be1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:23.578863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1ffe9e53-1df2-4bf5-89f3-2bfbe1879be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:23.637776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1176/2376] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:23.646272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f7c10-8b10-46b2-9df4-45d84aeedf57 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.646567 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f7c10-8b10-46b2-9df4-45d84aeedf57 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.646919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f7c10-8b10-46b2-9df4-45d84aeedf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.665627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-909f7c10-8b10-46b2-9df4-45d84aeedf57 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:23.666929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-909f7c10-8b10-46b2-9df4-45d84aeedf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:23.675119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1201/2377] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:23.679308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe9e53-1df2-4bf5-89f3-2bfbe1879be1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:23.689657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe9e53-1df2-4bf5-89f3-2bfbe1879be1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:23.694302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:23.695007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.695280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.695553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.696287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:39:23.696594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:23.698180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:23.711201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1177/2378] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:39:23.715470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f7c10-8b10-46b2-9df4-45d84aeedf57 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:23.721149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:23.724870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f7c10-8b10-46b2-9df4-45d84aeedf57 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:23.729577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b42547-a001-4563-8fa6-4a31e3a3069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:23.733954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b42547-a001-4563-8fa6-4a31e3a3069d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.733954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b42547-a001-4563-8fa6-4a31e3a3069d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.733954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b42547-a001-4563-8fa6-4a31e3a3069d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.733954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b42547-a001-4563-8fa6-4a31e3a3069d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:23.733954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b42547-a001-4563-8fa6-4a31e3a3069d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:23.846878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1202/2379] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:39:23 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:39:23.851054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:23.856143 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:23.861377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e573dc-a8eb-44af-a454-ab780dd4c0a4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:23.881912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a392-f325-49ae-b593-882163574fd0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.882198 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a392-f325-49ae-b593-882163574fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.882633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39a392-f325-49ae-b593-882163574fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.901425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fd39a392-f325-49ae-b593-882163574fd0 None None] MFA Rules not processed for user `f004a4778f7d46119108b09bdccb8739`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:23.902759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fd39a392-f325-49ae-b593-882163574fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:23.919461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:23.920270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:23.921068 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:23.921336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:23.922025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:23.923995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:23.960343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1203/2380] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:24.057597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1178/2381] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:39:23 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:39:24.061961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39a392-f325-49ae-b593-882163574fd0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.072597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39a392-f325-49ae-b593-882163574fd0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.077497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.078172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.078461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.078776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.079509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.081107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.091781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1204/2382] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:24.096006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.106203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcee10e-2c38-4aac-8317-38e4426c8350 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.111464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.112129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.112420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.112705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.113435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.115086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.126035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1179/2383] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:39:24.130048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.140531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dea54d-3be4-4e3d-adce-b0c56249af59 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.146092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dba6e6-eeee-43d3-81f1-795fad4571bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.147029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dba6e6-eeee-43d3-81f1-795fad4571bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.147314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dba6e6-eeee-43d3-81f1-795fad4571bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.147595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dba6e6-eeee-43d3-81f1-795fad4571bd admin admin] PATH_INFO: `/v3/projects/59d62f9b56aa49428ffe0c6ee2c621e5/users/54661d527691447ea53bb3e24c85fa11/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.162801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dba6e6-eeee-43d3-81f1-795fad4571bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d62f9b56aa49428ffe0c6ee2c621e5, user_id=54661d527691447ea53bb3e24c85fa11, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.165707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dba6e6-eeee-43d3-81f1-795fad4571bd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.270364 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.277214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.277355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1205/2384] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:39:24 2022] PUT /identity/v3/projects/59d62f9b56aa49428ffe0c6ee2c621e5/users/54661d527691447ea53bb3e24c85fa11/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:24.286468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.286796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.287078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.314575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] MFA Rules not processed for user `54661d527691447ea53bb3e24c85fa11`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:24.322537 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.333966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7257ce-1516-4ee6-b8b0-92e8a0880e32 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.388708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.389414 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.389723 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.389996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.394930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1206/2385] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:39:24.395105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.402276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.402695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:24.403821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.404093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:24.412788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1180/2386] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:24.451546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:24.463165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e92c1c-2056-4497-ac51-9c6e59c96f93 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:24.466929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b305d50-c383-458f-b00f-dfff35bfb2d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:24.468108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305d50-c383-458f-b00f-dfff35bfb2d0 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:24.468391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305d50-c383-458f-b00f-dfff35bfb2d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:24.468684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305d50-c383-458f-b00f-dfff35bfb2d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:24.477220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b305d50-c383-458f-b00f-dfff35bfb2d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:24.478763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b305d50-c383-458f-b00f-dfff35bfb2d0 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:24.488886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1207/2387] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:39:34.409191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:34.570865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:56.180749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:56.250660 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466186-c885-4e9f-ae37-159a8e0a228f service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:56.255284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:56.256188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:56.256467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:56.256827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] PATH_INFO: `/v3/users/54661d527691447ea53bb3e24c85fa11` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:56.257914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54661d527691447ea53bb3e24c85fa11)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:56.260013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:56.423748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54661d527691447ea53bb3e24c85fa11'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:56.435297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54661d527691447ea53bb3e24c85fa11'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:56.435959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54661d527691447ea53bb3e24c85fa11'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:56.507127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54661d527691447ea53bb3e24c85fa11'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:56.507758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54661d527691447ea53bb3e24c85fa11'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:56.521545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1181/2388] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:39:56 2022] DELETE /identity/v3/users/54661d527691447ea53bb3e24c85fa11 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:39:56.526104 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:56.526597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:56.526810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:56.544217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:39:56.545394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:56.603667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1208/2389] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:39:56.614179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:56.615676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:56.672726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ab1f-e639-4cd0-ae24-0561c298b2f3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:56.676545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158a8e-12ef-45fc-a901-ba195985fde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:56.677121 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158a8e-12ef-45fc-a901-ba195985fde5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:56.677406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158a8e-12ef-45fc-a901-ba195985fde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:56.677682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158a8e-12ef-45fc-a901-ba195985fde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:56.687308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59158a8e-12ef-45fc-a901-ba195985fde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:56.688813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59158a8e-12ef-45fc-a901-ba195985fde5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:56.698249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1182/2390] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:39:57.086299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:39:57.087759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:39:57.101718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e24ae-6cd7-4f8b-8de4-510c4ef24d52 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:39:57.106664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:39:57.107740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:39:57.108071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:39:57.109135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] PATH_INFO: `/v3/projects/59d62f9b56aa49428ffe0c6ee2c621e5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:39:57.110459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d62f9b56aa49428ffe0c6ee2c621e5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:39:57.112452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:39:57.205055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d62f9b56aa49428ffe0c6ee2c621e5', 'request_id': 'req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:57.250344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d62f9b56aa49428ffe0c6ee2c621e5', 'request_id': 'req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:57.256362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d62f9b56aa49428ffe0c6ee2c621e5', 'request_id': 'req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:57.267772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] The token cache is being invalidate because project 59d62f9b56aa49428ffe0c6ee2c621e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:39:57.268061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:57.268707 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:39:57.270282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1209/2391] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:39:57 2022] DELETE /identity/v3/projects/59d62f9b56aa49428ffe0c6ee2c621e5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:40:06.693987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:07.264664 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:09.326800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:09.330982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:09.330982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:09.356796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:40:09.358046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:09.414104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1183/2392] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:40:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:40:09.642674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:09.644088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:09.714186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fd6e6-d2f3-4bab-89e0-fad29c9251f5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:09.719212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:09.719862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:09.720180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:09.720460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:09.728703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:09.730296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:09.738499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1210/2393] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:40:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:40:19.407666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=29 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:19.736114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=32 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:28.592035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:28.593420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:28.653164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e03bf3-224d-4fca-a941-e6bafed637e9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:28.656734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:28.657376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:28.657663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:28.657940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:28.659755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:28.740970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:28.742332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:28.754584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1184/2394] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:31.117710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:31.119176 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:31.181335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69eb1e-dfa4-47a8-9cbe-d05b5e8d04f1 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:31.184981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:31.185626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:31.185910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:31.186186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:31.188002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:31.200991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:31.202416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:31.213728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1211/2395] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:31.438607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:31.438607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:31.496559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b9496-4bf8-4f16-b87d-6096f1e82d76 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:31.500118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:31.506362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:31.506362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:31.506362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:31.506362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:31.513387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:31.514876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:31.523341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1185/2396] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:31.599729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:31.609400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b56d36-2be8-4091-a801-7e5bfdc58805 service glance] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:31.613069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1341903-a921-4bc2-b0fc-9b7250f39fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:31.613706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341903-a921-4bc2-b0fc-9b7250f39fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:31.613991 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341903-a921-4bc2-b0fc-9b7250f39fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:31.614270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341903-a921-4bc2-b0fc-9b7250f39fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:31.616073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1341903-a921-4bc2-b0fc-9b7250f39fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:31.630049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1341903-a921-4bc2-b0fc-9b7250f39fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:31.631569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1341903-a921-4bc2-b0fc-9b7250f39fa1 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:31.643143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1212/2397] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:32.226755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:32.229185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:32.239814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edf776-451e-42d3-8a25-400953ef0256 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:32.245171 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:32.245919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:32.246202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:32.246478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:32.248508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:32.263774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:32.265207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:32.277107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1186/2398] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:34.567224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:34.567750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:34.567871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:34.587644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:40:34.588803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:34.596142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1213/2399] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Jul 20 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:40:34.610374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:34.622577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44ab6c-4681-4805-bd2f-2c6bc7e5cf3f service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:34.627865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:34.628578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:34.628933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:34.629281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:34.638032 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:34.639638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:34.648088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1187/2400] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 15:40:44.580411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=35 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:44.644502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:46.634708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:46.636860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:46.652493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9341a6-4f94-42b0-80fe-5f64da044616 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:46.658042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933fe56-f102-40a8-8a72-a3262e98327b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:46.658535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fe56-f102-40a8-8a72-a3262e98327b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:46.658865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fe56-f102-40a8-8a72-a3262e98327b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:46.659250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933fe56-f102-40a8-8a72-a3262e98327b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:46.660911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e933fe56-f102-40a8-8a72-a3262e98327b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:46.744065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933fe56-f102-40a8-8a72-a3262e98327b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:46.746295 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933fe56-f102-40a8-8a72-a3262e98327b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:46.765677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1214/2401] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:48.451395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:48.460770 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807cf70-74ce-44e7-9d4e-88f86814c1d6 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:48.464543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:48.465175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:48.465461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:48.465741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:48.467532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:48.527447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:48.528911 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:48.538016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1188/2402] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:40:56.762974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=41 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:56.771401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc85377-abcf-4415-8bee-06f3f17094bc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:56.771695 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc85377-abcf-4415-8bee-06f3f17094bc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:56.779752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc85377-abcf-4415-8bee-06f3f17094bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:56.791989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7dc85377-abcf-4415-8bee-06f3f17094bc None None] MFA Rules not processed for user `941ae32ff5224143a43f92f7251822de`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:40:56.793332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7dc85377-abcf-4415-8bee-06f3f17094bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:56.803509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1215/2403] 10.222.0.87 () {58 vars in 967 bytes} [Wed Jul 20 15:40:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:40:56.818807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:56.830672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd73db-f49d-491d-be72-339f437d4efd service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:56.837036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1ffde1b21246acb7092df7616e2a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:56.837693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:56.837978 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:56.838310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:56.850868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:56.865906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:56.865906 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1189/2404] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Jul 20 15:40:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 15:40:58.689767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc85377-abcf-4415-8bee-06f3f17094bc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:40:58.699937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc85377-abcf-4415-8bee-06f3f17094bc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:40:58.703551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:40:58.704197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:40:58.704484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:40:58.704765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:40:58.706569 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:40:58.777982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:40:58.790336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:40:58.790336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1216/2405] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:01.283287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:01.293695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30db10-fbb0-4976-ae08-e4990a0c1996 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:01.297613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:01.298259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:01.298542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:01.298854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:01.300654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:01.313674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:01.315198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:01.325244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1190/2406] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:06.212524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:06.214563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:06.232972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe291d1-480a-4e63-aa76-0c45c109c2a6 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:06.239548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:06.240521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:06.240881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:06.241236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] PATH_INFO: `/v3/users/760a7a314a9c4a788e751ce19c13ff93` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:06.257279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=760a7a314a9c4a788e751ce19c13ff93)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:06.258953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:06.418609 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760a7a314a9c4a788e751ce19c13ff93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.430739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760a7a314a9c4a788e751ce19c13ff93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.472482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760a7a314a9c4a788e751ce19c13ff93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.473170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760a7a314a9c4a788e751ce19c13ff93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.473740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-af6f9c6c-84c3-49fc-9e5a-756f73c47e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760a7a314a9c4a788e751ce19c13ff93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.487047 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1217/2407] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:06 2022] DELETE /identity/v3/users/760a7a314a9c4a788e751ce19c13ff93 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:06.761017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:06.778942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547485c-a48b-426b-99a0-61015385cf32 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:06.837983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:06.839422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:06.839705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:06.839981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] PATH_INFO: `/v3/projects/113db904c27a411ea9ccf082b883da86` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:06.850350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=113db904c27a411ea9ccf082b883da86)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:06.852335 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:06.973952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113db904c27a411ea9ccf082b883da86', 'request_id': 'req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.980363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113db904c27a411ea9ccf082b883da86', 'request_id': 'req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.991429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113db904c27a411ea9ccf082b883da86', 'request_id': 'req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:06.999802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:07.063040 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] The token cache is being invalidate because project 113db904c27a411ea9ccf082b883da86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:07.067110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:07.067110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9513e6c2-8cee-4cb1-bd4b-f24e61ff50cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:07.067110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1191/2408] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:06 2022] DELETE /identity/v3/projects/113db904c27a411ea9ccf082b883da86 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:07.070763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880ea28-aeb7-4480-9954-588817c2e8d9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.074111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880ea28-aeb7-4480-9954-588817c2e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.074399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880ea28-aeb7-4480-9954-588817c2e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.097727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6880ea28-aeb7-4480-9954-588817c2e8d9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:07.097727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6880ea28-aeb7-4480-9954-588817c2e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:07.160083 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:07.183875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1218/2409] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:07.191609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7872-908d-4a58-aa38-a8c09943f561 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.192159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7872-908d-4a58-aa38-a8c09943f561 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.192605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d7872-908d-4a58-aa38-a8c09943f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.212210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f10d7872-908d-4a58-aa38-a8c09943f561 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:07.216087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f10d7872-908d-4a58-aa38-a8c09943f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:07.224320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1192/2410] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:07.230335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880ea28-aeb7-4480-9954-588817c2e8d9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.240764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880ea28-aeb7-4480-9954-588817c2e8d9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.246289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.247004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.247287 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.247563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.248360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:41:07.250614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.250614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.266958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1219/2411] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:41:07.268186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d7872-908d-4a58-aa38-a8c09943f561 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.279760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d7872-908d-4a58-aa38-a8c09943f561 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.285636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.290872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.290872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.290872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.290872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.290872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.406521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1193/2412] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:07 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:07.410581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.421516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437323d9-8260-4471-be6e-c6f1d08ded44 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.480851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.481577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.482485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.482485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.482925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.484853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.495309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.497168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:07.544747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1220/2413] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:07 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:07.549331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.560621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7f4b-6468-41d3-8496-0ed5ff4a7601 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.565317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.565970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.568482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.568482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.568482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.568859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.578674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284cc1-dab5-419b-8646-e663b03b73c9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.579881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1221/2414] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:07.583688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.583887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.584581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.584866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.585142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.586968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:07.601643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.602316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f2da0-0bf3-4658-a0d1-ebfde292b8ca admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.603331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.608668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.609591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.609985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.610366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.611425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.613211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.614384 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1194/2415] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:07.615436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.616997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:07.625853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1222/2416] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:41:07.630382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.631755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29f2e-6450-404b-b0c3-d3edd005086a service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.637353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.638458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.638717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.639004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] PATH_INFO: `/v3/users/e7723c980dbe4120afe36d4796c15cfb` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.640365 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7723c980dbe4120afe36d4796c15cfb)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.642061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288ab6-c170-465a-a99e-6d6eb698c85c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:07.642289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.647422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee1a57-eb46-4087-bd54-b1f8d41df20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:07.648274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee1a57-eb46-4087-bd54-b1f8d41df20d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.648560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee1a57-eb46-4087-bd54-b1f8d41df20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.648843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee1a57-eb46-4087-bd54-b1f8d41df20d admin admin] PATH_INFO: `/v3/projects/098ecf74bdfd40f1adb98a7ee08d7223/users/69f93f22dcaa4834a7dd5e3d3edf7eb5/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.664647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee1a57-eb46-4087-bd54-b1f8d41df20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=098ecf74bdfd40f1adb98a7ee08d7223, user_id=69f93f22dcaa4834a7dd5e3d3edf7eb5, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:07.667658 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee1a57-eb46-4087-bd54-b1f8d41df20d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:07.769895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1223/2417] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:07 2022] PUT /identity/v3/projects/098ecf74bdfd40f1adb98a7ee08d7223/users/69f93f22dcaa4834a7dd5e3d3edf7eb5/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:07.779982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:07.780276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:07.780556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:07.806315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] MFA Rules not processed for user `69f93f22dcaa4834a7dd5e3d3edf7eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:07.808055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:07.841321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7723c980dbe4120afe36d4796c15cfb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:07.859573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7723c980dbe4120afe36d4796c15cfb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:07.859573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7723c980dbe4120afe36d4796c15cfb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:07.874512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1224/2418] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:07.886416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:07.887947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:07.898692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:07.947234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7723c980dbe4120afe36d4796c15cfb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:07.948776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7723c980dbe4120afe36d4796c15cfb'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:07.965350 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1195/2419] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:07 2022] DELETE /identity/v3/users/e7723c980dbe4120afe36d4796c15cfb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:08.085255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086536b-b9ab-4967-94fa-12b64c2b156e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:08.150132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:08.150882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:08.151190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:08.151481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:08.207127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:08.208770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:08.218411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1225/2420] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:41:08.222845 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:08.225439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:08.247962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:08.303478 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142414c-56bb-4bcc-a64c-747a2975374d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:08.308317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:08.309264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:08.309643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:08.309970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] PATH_INFO: `/v3/projects/87eff7a42b92407381c30234c4cebaec` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:08.311289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] RBAC: Authorizing `identity:delete_project(project_id=87eff7a42b92407381c30234c4cebaec)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:08.313714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:08.403457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87eff7a42b92407381c30234c4cebaec', 'request_id': 'req-2331323c-17d6-485c-9c96-134ef9f1341b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.409059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87eff7a42b92407381c30234c4cebaec', 'request_id': 'req-2331323c-17d6-485c-9c96-134ef9f1341b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.417748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87eff7a42b92407381c30234c4cebaec', 'request_id': 'req-2331323c-17d6-485c-9c96-134ef9f1341b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.463933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] The token cache is being invalidate because project 87eff7a42b92407381c30234c4cebaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:08.464229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.465588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.470876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1196/2421] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:08 2022] DELETE /identity/v3/projects/87eff7a42b92407381c30234c4cebaec => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:08.472027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:08.488233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:08.489688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:08.489866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcaeb0-40e5-49ae-a7f7-a3ecd8d47bbb service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:08.539050 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:08.554398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:08.555403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:08.555752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:08.556092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] PATH_INFO: `/v3/users/df3273e4246641e1b718b51e1b2f738a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:08.557981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3273e4246641e1b718b51e1b2f738a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:08.560053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:08.561021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331323c-17d6-485c-9c96-134ef9f1341b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:08.565713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:08.566584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:08.566900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:08.567179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] PATH_INFO: `/v3/users/69f93f22dcaa4834a7dd5e3d3edf7eb5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:08.568567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f93f22dcaa4834a7dd5e3d3edf7eb5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:08.570569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:08.721779 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3273e4246641e1b718b51e1b2f738a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.726874 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f93f22dcaa4834a7dd5e3d3edf7eb5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.729111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:08.734233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3273e4246641e1b718b51e1b2f738a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.740277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f93f22dcaa4834a7dd5e3d3edf7eb5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.741210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f93f22dcaa4834a7dd5e3d3edf7eb5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.780882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3273e4246641e1b718b51e1b2f738a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.781502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3273e4246641e1b718b51e1b2f738a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.782117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6de3a182-de0e-4296-b4cd-7a1acc5ac3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3273e4246641e1b718b51e1b2f738a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.795049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1226/2422] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:08 2022] DELETE /identity/v3/users/df3273e4246641e1b718b51e1b2f738a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:08.821074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f93f22dcaa4834a7dd5e3d3edf7eb5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.821727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f93f22dcaa4834a7dd5e3d3edf7eb5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:08.836731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1197/2423] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:08 2022] DELETE /identity/v3/users/69f93f22dcaa4834a7dd5e3d3edf7eb5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:08.841821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:08.842274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:08.842773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:08.860637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:08.861848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:08.921822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1227/2424] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:08.931458 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:08.932945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:08.991473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caddd3-ec69-4cbf-9161-59f353e6e1dd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:08.995077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:08.995717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:08.996000 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:08.996277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:09.005287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:09.006756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:09.017025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1198/2425] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:09.046541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:09.048181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:09.073638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2deac07-a602-47ba-aab3-8366568cf906 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:09.079057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:09.080026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:09.080383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:09.080869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] PATH_INFO: `/v3/projects/e66c98dd287b474b9f73ce4c8d2f1992` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:09.082266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66c98dd287b474b9f73ce4c8d2f1992)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:09.084315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:09.215968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66c98dd287b474b9f73ce4c8d2f1992', 'request_id': 'req-6f619744-dcd4-45ed-8d2b-eee135808560'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.300979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66c98dd287b474b9f73ce4c8d2f1992', 'request_id': 'req-6f619744-dcd4-45ed-8d2b-eee135808560'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.303514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:09.308281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66c98dd287b474b9f73ce4c8d2f1992', 'request_id': 'req-6f619744-dcd4-45ed-8d2b-eee135808560'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.319755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] The token cache is being invalidate because project e66c98dd287b474b9f73ce4c8d2f1992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:09.320164 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.321029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f619744-dcd4-45ed-8d2b-eee135808560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.334675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1228/2426] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:09 2022] DELETE /identity/v3/projects/e66c98dd287b474b9f73ce4c8d2f1992 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:09.486661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:09.488230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:09.514251 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91c510-134d-4a38-a982-925faeb4ca09 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:09.581404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:09.582284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:09.582568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:09.582878 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] PATH_INFO: `/v3/projects/098ecf74bdfd40f1adb98a7ee08d7223` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:09.584078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098ecf74bdfd40f1adb98a7ee08d7223)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:09.586131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:09.730288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098ecf74bdfd40f1adb98a7ee08d7223', 'request_id': 'req-86be562b-19b0-4d7b-abe6-f33fec2cee58'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.735989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098ecf74bdfd40f1adb98a7ee08d7223', 'request_id': 'req-86be562b-19b0-4d7b-abe6-f33fec2cee58'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.742683 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098ecf74bdfd40f1adb98a7ee08d7223', 'request_id': 'req-86be562b-19b0-4d7b-abe6-f33fec2cee58'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.788168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:09.792447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] The token cache is being invalidate because project 098ecf74bdfd40f1adb98a7ee08d7223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:09.792741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.793387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86be562b-19b0-4d7b-abe6-f33fec2cee58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:09.794976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1199/2427] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:09 2022] DELETE /identity/v3/projects/098ecf74bdfd40f1adb98a7ee08d7223 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:09.799907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b0c67-ff68-47b2-84af-8bdcf241ffd3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:09.800425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b0c67-ff68-47b2-84af-8bdcf241ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:09.800529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b0c67-ff68-47b2-84af-8bdcf241ffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:09.818846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0a6b0c67-ff68-47b2-84af-8bdcf241ffd3 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:09.820197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0a6b0c67-ff68-47b2-84af-8bdcf241ffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:09.879465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1229/2428] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:09.888865 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a660833-3e6b-484e-980c-f662cc91bbcc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:09.889152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a660833-3e6b-484e-980c-f662cc91bbcc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:09.889430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a660833-3e6b-484e-980c-f662cc91bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:09.909340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7a660833-3e6b-484e-980c-f662cc91bbcc None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:09.910522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7a660833-3e6b-484e-980c-f662cc91bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:09.919370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1200/2429] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:09.923438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b0c67-ff68-47b2-84af-8bdcf241ffd3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:09.933212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b0c67-ff68-47b2-84af-8bdcf241ffd3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:09.937802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:09.938451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:09.938774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:09.939057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:09.939780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:41:09.940118 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:09.941830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:09.953286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1230/2430] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:41:09.957281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a660833-3e6b-484e-980c-f662cc91bbcc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:09.967373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a660833-3e6b-484e-980c-f662cc91bbcc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:09.972385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:09.973033 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:09.973323 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:09.973606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:09.974295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:09.976229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.057012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1201/2431] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:09 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:10.061438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.071679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf3e13-5288-4eb8-ba9d-29809a22ba85 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.128098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.128808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.129092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.129368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.130082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.132011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.216141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1231/2432] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:10 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:10.224940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.235195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d324-9363-4b2e-83ca-132e12c4e3ec admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.239739 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.240388 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.240674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.240954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.241676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.243318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.253697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1202/2433] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:10.257584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.268095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1352b8-46ef-4787-aac3-44e7f04e7936 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.272870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd74799-ec75-4910-85ee-d7104a40de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.273521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74799-ec75-4910-85ee-d7104a40de48 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.273804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74799-ec75-4910-85ee-d7104a40de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.274077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd74799-ec75-4910-85ee-d7104a40de48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.274863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd74799-ec75-4910-85ee-d7104a40de48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.277443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd74799-ec75-4910-85ee-d7104a40de48 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.288061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1232/2434] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:10.292729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.302494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b47a5d-9e0c-4099-b4a0-301a08e74815 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.307208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.308017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.308301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.308577 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] PATH_INFO: `/v3/projects/babc010dc2db4090ba1881e81a9a35e2/users/545e4bdf28204020ab2cd8ea6daf5e04/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.323827 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babc010dc2db4090ba1881e81a9a35e2, user_id=545e4bdf28204020ab2cd8ea6daf5e04, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.326493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.388015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1203/2435] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:10 2022] PUT /identity/v3/projects/babc010dc2db4090ba1881e81a9a35e2/users/545e4bdf28204020ab2cd8ea6daf5e04/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:10.398461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be1e1-2afd-48d8-bd69-8d1c8f38ba75 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.398790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be1e1-2afd-48d8-bd69-8d1c8f38ba75 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.399134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be1e1-2afd-48d8-bd69-8d1c8f38ba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.426563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6e4be1e1-2afd-48d8-bd69-8d1c8f38ba75 None None] MFA Rules not processed for user `545e4bdf28204020ab2cd8ea6daf5e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:10.427801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6e4be1e1-2afd-48d8-bd69-8d1c8f38ba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:10.468625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:10.490387 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1233/2436] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:10.494995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.558547 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30978c-d24f-47c0-b497-047aeb8df652 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.563206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.563863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.564150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.564429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.565123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.567080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.661553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1204/2437] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:10 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:10.665808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be1e1-2afd-48d8-bd69-8d1c8f38ba75 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.676790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be1e1-2afd-48d8-bd69-8d1c8f38ba75 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.733268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.733965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.734278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.734556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.735282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.737239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.836938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1234/2438] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:10 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:10.846170 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.856855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c5996-cec7-4eef-bfb7-111e31768588 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.861556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.862207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.862496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.862809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.863532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.865185 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.876318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1205/2439] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:10.880683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:10.891279 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ec032-d620-4f21-b1bf-c42a12754428 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:10.895889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:10.896774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:10.897059 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:10.897366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] PATH_INFO: `/v3/projects/bafc1724bde74298ba15681f34009a3b/users/2f901877eb1e4f249c732a5ac1140d66/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:10.911739 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafc1724bde74298ba15681f34009a3b, user_id=2f901877eb1e4f249c732a5ac1140d66, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:10.914369 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:10.998259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1235/2440] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:10 2022] PUT /identity/v3/projects/bafc1724bde74298ba15681f34009a3b/users/2f901877eb1e4f249c732a5ac1140d66/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:11.002324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:11.012532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaebcc8-e241-4ceb-b443-99986d8650ea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:11.068813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff1391-ece0-4f37-a44c-884b5afedef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:11.069480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff1391-ece0-4f37-a44c-884b5afedef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:11.069765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff1391-ece0-4f37-a44c-884b5afedef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:11.070043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff1391-ece0-4f37-a44c-884b5afedef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:11.070796 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff1391-ece0-4f37-a44c-884b5afedef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:11.072420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff1391-ece0-4f37-a44c-884b5afedef3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:11.082045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1206/2441] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:11.086242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:11.096878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5796ff4-e014-4747-8fab-3383a0ef1196 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:11.101480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:11.102363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:11.102672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:11.102962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] PATH_INFO: `/v3/projects/bafc1724bde74298ba15681f34009a3b/users/2f901877eb1e4f249c732a5ac1140d66/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:11.105532 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafc1724bde74298ba15681f34009a3b, user_id=2f901877eb1e4f249c732a5ac1140d66, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:11.108197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:11.118530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1236/2442] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:11 2022] PUT /identity/v3/projects/bafc1724bde74298ba15681f34009a3b/users/2f901877eb1e4f249c732a5ac1140d66/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:11.128999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a6a2c-bcac-498b-8a49-7f22c7a27485 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:11.129294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a6a2c-bcac-498b-8a49-7f22c7a27485 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:11.129576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a6a2c-bcac-498b-8a49-7f22c7a27485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:11.142025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:11.156024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-da9a6a2c-bcac-498b-8a49-7f22c7a27485 None None] MFA Rules not processed for user `2f901877eb1e4f249c732a5ac1140d66`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:11.157237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-da9a6a2c-bcac-498b-8a49-7f22c7a27485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:11.224928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1207/2443] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:11.236958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:11.238663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:11.296423 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ae869-5c58-4be9-aeee-ccfea45d54ba admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:11.300131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:11.300769 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:11.301053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:11.301329 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:11.310392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:11.311887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:11.321327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1237/2444] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:11.522522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a6a2c-bcac-498b-8a49-7f22c7a27485 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:11.532760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a6a2c-bcac-498b-8a49-7f22c7a27485 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:11.536371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:11.537006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:11.537314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:11.537589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:11.593994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:11.595484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:11.604892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1208/2445] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:21.317127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=78,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:21.600254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=59 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:32.355454 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:32.356946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:32.415464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb062e4a-a0de-49e2-8460-a4d690d28dc2 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:32.419301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:32.420729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:32.421003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:32.421278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:32.423162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:32.485368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:32.486831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:32.496417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1238/2446] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:35.953055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:35.954711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:35.969306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729807c-0c05-46e7-80fe-59afbd613803 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:35.973836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:35.974783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:35.975069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:35.975349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] PATH_INFO: `/v3/users/f004a4778f7d46119108b09bdccb8739` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:35.990501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f004a4778f7d46119108b09bdccb8739)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:35.991236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:36.253239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f004a4778f7d46119108b09bdccb8739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:36.265861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f004a4778f7d46119108b09bdccb8739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:36.266541 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f004a4778f7d46119108b09bdccb8739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:36.346294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f004a4778f7d46119108b09bdccb8739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:36.347070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b702b70-bae8-47fc-a7ee-c7ef1f936228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f004a4778f7d46119108b09bdccb8739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:36.360594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1209/2447] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:35 2022] DELETE /identity/v3/users/f004a4778f7d46119108b09bdccb8739 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:36.685453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:36.698324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f00c3-6868-43a5-9d07-01fe54a47b07 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:36.758606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:36.759540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:36.759828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:36.760107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] PATH_INFO: `/v3/projects/0663e49807df40e998bb8bc388ea863d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:36.770851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0663e49807df40e998bb8bc388ea863d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:36.772714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:36.927180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:36.930873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0663e49807df40e998bb8bc388ea863d', 'request_id': 'req-f316e410-d6cc-4be7-a7c5-47a55cbae466'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:37.026422 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0663e49807df40e998bb8bc388ea863d', 'request_id': 'req-f316e410-d6cc-4be7-a7c5-47a55cbae466'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:37.033724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0663e49807df40e998bb8bc388ea863d', 'request_id': 'req-f316e410-d6cc-4be7-a7c5-47a55cbae466'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:37.045614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] The token cache is being invalidate because project 0663e49807df40e998bb8bc388ea863d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:37.045907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:37.047218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f316e410-d6cc-4be7-a7c5-47a55cbae466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:37.048899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1239/2448] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:36 2022] DELETE /identity/v3/projects/0663e49807df40e998bb8bc388ea863d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:37.053992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f91b-644b-4a38-8ae4-f767a1436104 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.054499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f91b-644b-4a38-8ae4-f767a1436104 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.054615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87f91b-644b-4a38-8ae4-f767a1436104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.072996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1a87f91b-644b-4a38-8ae4-f767a1436104 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:37.074197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1a87f91b-644b-4a38-8ae4-f767a1436104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:37.133344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1210/2449] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:37.141910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c567e51-e843-480e-b5b1-ff934ea9c133 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.142212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c567e51-e843-480e-b5b1-ff934ea9c133 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.142463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c567e51-e843-480e-b5b1-ff934ea9c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.161559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0c567e51-e843-480e-b5b1-ff934ea9c133 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:37.162774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0c567e51-e843-480e-b5b1-ff934ea9c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:37.170792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1240/2450] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:37.175877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f91b-644b-4a38-8ae4-f767a1436104 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:37.185609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87f91b-644b-4a38-8ae4-f767a1436104 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:37.190272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:37.191025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.191315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.191599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.192329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:41:37.192642 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:37.194234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:37.206455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1211/2451] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:41:37.210842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c567e51-e843-480e-b5b1-ff934ea9c133 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:37.220622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c567e51-e843-480e-b5b1-ff934ea9c133 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:37.225359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:37.226018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.226302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.227412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.227412 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:37.229174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:37.385907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1241/2452] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:37 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:37.387263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:37.398173 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12caff-b8ea-4714-8eb4-833f7eb10001 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:37.447812 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:37.461338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:37.470421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.470421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.470421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.470421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:37.470421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:37.592630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1212/2453] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:37 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:37.597470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:37.611622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6204e6-5174-47e9-a936-b6d8489502c8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:37.616901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:37.617571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.617852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.618125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.618958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:37.620618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:37.632172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1242/2454] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:37.636156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:37.646772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c6be1-60ec-41fd-8d55-b472e9914d9a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:37.651868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65f78-4d19-47ed-b4c3-6307cfc5441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:37.652525 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65f78-4d19-47ed-b4c3-6307cfc5441b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.652801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65f78-4d19-47ed-b4c3-6307cfc5441b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.653083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65f78-4d19-47ed-b4c3-6307cfc5441b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.653804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65f78-4d19-47ed-b4c3-6307cfc5441b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:37.655760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65f78-4d19-47ed-b4c3-6307cfc5441b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:37.669752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1213/2455] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:37.670923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:37.681302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c410638-c130-4980-8a04-81f1efb382f5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:37.686207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:37.687718 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.687994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.688265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] PATH_INFO: `/v3/projects/69765e0db5e04c9f882a601d3220be5f/users/459feca1f31f47949ea602981a2e3920/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.704472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69765e0db5e04c9f882a601d3220be5f, user_id=459feca1f31f47949ea602981a2e3920, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:37.707145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:37.793101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1243/2456] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:37 2022] PUT /identity/v3/projects/69765e0db5e04c9f882a601d3220be5f/users/459feca1f31f47949ea602981a2e3920/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:37.803362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3114f-e077-4d4f-b02e-ad05d80e7737 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.803663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3114f-e077-4d4f-b02e-ad05d80e7737 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.804025 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3114f-e077-4d4f-b02e-ad05d80e7737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:37.833217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a9a3114f-e077-4d4f-b02e-ad05d80e7737 None None] MFA Rules not processed for user `459feca1f31f47949ea602981a2e3920`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:37.834439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a9a3114f-e077-4d4f-b02e-ad05d80e7737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:37.903082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1214/2457] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:37.916829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:37.916829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:37.991196 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98cf49-6830-4dc8-b309-9886bd13590e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:37.996800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18359b96-fcd4-4046-8dd2-80eb6a0d9194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:37.997445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359b96-fcd4-4046-8dd2-80eb6a0d9194 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:37.997731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359b96-fcd4-4046-8dd2-80eb6a0d9194 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:37.998012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18359b96-fcd4-4046-8dd2-80eb6a0d9194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:38.006263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18359b96-fcd4-4046-8dd2-80eb6a0d9194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:38.007870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18359b96-fcd4-4046-8dd2-80eb6a0d9194 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:38.017342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1244/2458] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:44.286981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3114f-e077-4d4f-b02e-ad05d80e7737 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:44.345508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3114f-e077-4d4f-b02e-ad05d80e7737 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:44.350955 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:44.351858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:44.352145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:44.352426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] PATH_INFO: `/v3/users/459feca1f31f47949ea602981a2e3920` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:44.353606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] RBAC: Authorizing `identity:delete_user(user_id=459feca1f31f47949ea602981a2e3920)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:44.355561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:44.585287 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459feca1f31f47949ea602981a2e3920'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:44.594288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:44.599392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459feca1f31f47949ea602981a2e3920'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:44.600127 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459feca1f31f47949ea602981a2e3920'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:44.666499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459feca1f31f47949ea602981a2e3920'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:44.667714 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459feca1f31f47949ea602981a2e3920'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:44.683598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1215/2459] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:44 2022] DELETE /identity/v3/users/459feca1f31f47949ea602981a2e3920 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:44.688197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:44.688686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:44.688810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:44.708301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:44.709734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:44.757425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:44.769914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1245/2460] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:44.779954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:44.781343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:44.839700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0bdb4-5ba9-48e5-9620-b139d124639f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:44.843223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982a00-e950-4fda-a0ad-e5e8e63bc620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:44.843858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982a00-e950-4fda-a0ad-e5e8e63bc620 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:44.844139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982a00-e950-4fda-a0ad-e5e8e63bc620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:44.844412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982a00-e950-4fda-a0ad-e5e8e63bc620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:44.853966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982a00-e950-4fda-a0ad-e5e8e63bc620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:44.855421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982a00-e950-4fda-a0ad-e5e8e63bc620 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:44.865817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1216/2461] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:45.314945 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:45.316560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:45.332601 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d120dd-a3cf-47b9-afd8-ea7f431212d2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:45.334027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:45.334942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:45.335232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:45.335518 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] PATH_INFO: `/v3/projects/69765e0db5e04c9f882a601d3220be5f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:45.336770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69765e0db5e04c9f882a601d3220be5f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:45.338736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:45.511911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69765e0db5e04c9f882a601d3220be5f', 'request_id': 'req-89f6d09d-957d-44d1-baf4-8d3f510870c8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:45.637619 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69765e0db5e04c9f882a601d3220be5f', 'request_id': 'req-89f6d09d-957d-44d1-baf4-8d3f510870c8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:45.644638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69765e0db5e04c9f882a601d3220be5f', 'request_id': 'req-89f6d09d-957d-44d1-baf4-8d3f510870c8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:45.655685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] The token cache is being invalidate because project 69765e0db5e04c9f882a601d3220be5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:45.655958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:45.656595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89f6d09d-957d-44d1-baf4-8d3f510870c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:45.658370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1246/2462] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:45 2022] DELETE /identity/v3/projects/69765e0db5e04c9f882a601d3220be5f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:45.664224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c41e-6703-428f-8b6d-70f8235edff0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:45.664788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c41e-6703-428f-8b6d-70f8235edff0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:45.664788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26c41e-6703-428f-8b6d-70f8235edff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:45.682665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8b26c41e-6703-428f-8b6d-70f8235edff0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:45.683846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8b26c41e-6703-428f-8b6d-70f8235edff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:45.743677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1217/2463] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:45.751373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa43909-e477-4198-96cc-c6013cde8d78 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:45.751859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa43909-e477-4198-96cc-c6013cde8d78 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:45.752004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa43909-e477-4198-96cc-c6013cde8d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:45.770730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9fa43909-e477-4198-96cc-c6013cde8d78 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:45.771929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9fa43909-e477-4198-96cc-c6013cde8d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:45.779781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1247/2464] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:45.784589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26c41e-6703-428f-8b6d-70f8235edff0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:45.794568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26c41e-6703-428f-8b6d-70f8235edff0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:45.799400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:45.799960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:45.800249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:45.800533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:45.801289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:41:45.801603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:45.803390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:45.815318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1218/2465] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:41:45.825221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa43909-e477-4198-96cc-c6013cde8d78 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:45.835029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa43909-e477-4198-96cc-c6013cde8d78 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:45.839640 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:45.840283 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:45.840566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:45.840846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:45.841534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:45.843475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:45.953529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1248/2466] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:45 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:45.958223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:45.968635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe40e29-bc54-4263-b8a9-ca9582a09dcc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:46.025600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:46.026273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:46.026558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:46.027149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:46.027556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:46.029479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:46.039230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:46.245299 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1219/2467] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:45 2022] POST /identity/v3/users => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:46.249288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:46.260236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee9e4d-6f5c-4b86-bbb8-1142a6072a21 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:46.264773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:46.265470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:46.265754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:46.266033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:46.266805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:46.268645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:46.279019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1249/2468] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:46.283274 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:46.293832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08dfad-e564-451c-88c6-805dbd2f9092 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:46.299843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0fd27-f96f-430f-a136-a1cd55b057e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:46.306076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0fd27-f96f-430f-a136-a1cd55b057e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:46.306076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0fd27-f96f-430f-a136-a1cd55b057e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:46.306076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0fd27-f96f-430f-a136-a1cd55b057e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:46.306076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0fd27-f96f-430f-a136-a1cd55b057e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:46.306076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0fd27-f96f-430f-a136-a1cd55b057e9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:46.314279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1220/2469] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:46.319156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:46.329209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961a6b-2edf-4c57-9ec5-3d15a049c439 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:46.334101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:46.335170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:46.335453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:46.335728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] PATH_INFO: `/v3/projects/3ba12b017e3d4c35ab1044728da1ce6e/users/5204571fec794f3d960a098db508f218/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:46.350783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba12b017e3d4c35ab1044728da1ce6e, user_id=5204571fec794f3d960a098db508f218, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:46.353479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:46.461974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1250/2470] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:46 2022] PUT /identity/v3/projects/3ba12b017e3d4c35ab1044728da1ce6e/users/5204571fec794f3d960a098db508f218/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:46.467034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a115-af19-4786-b9c7-a70c400a8b12 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:46.467322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a115-af19-4786-b9c7-a70c400a8b12 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:46.467600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a115-af19-4786-b9c7-a70c400a8b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:46.484963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3818a115-af19-4786-b9c7-a70c400a8b12 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:46.486158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3818a115-af19-4786-b9c7-a70c400a8b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:46.545719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1221/2471] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:46.555471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:46.559784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:46.614607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c879-b761-4aa3-b742-c909f3033ae4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:46.618376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:46.619061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:46.619352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:46.619633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:46.629540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:46.631003 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:46.640476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1251/2472] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:48.023521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889ca2-1331-4a9c-b9f7-5ccce3d76f7e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:48.024029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889ca2-1331-4a9c-b9f7-5ccce3d76f7e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:48.024139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889ca2-1331-4a9c-b9f7-5ccce3d76f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:48.053192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3f889ca2-1331-4a9c-b9f7-5ccce3d76f7e None None] MFA Rules not processed for user `5204571fec794f3d960a098db508f218`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:48.054486 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3f889ca2-1331-4a9c-b9f7-5ccce3d76f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:48.132734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1222/2473] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:48.141392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:48.151817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec6a05-c606-4484-b1f7-d4dc5e7a38bc service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:48.156382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:48.156981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:48.157261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:48.157534 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:48.158222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:48.160715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:48.175600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:48.256942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1252/2474] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:48 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:48.261136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889ca2-1331-4a9c-b9f7-5ccce3d76f7e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:48.273467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889ca2-1331-4a9c-b9f7-5ccce3d76f7e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:48.332079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:48.332751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:48.333036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:48.333311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:48.333995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:48.335962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:48.421239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1223/2475] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:48 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:48.425411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:48.435777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92426749-55db-481d-8c8d-4fc304c96540 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:48.441006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:48.441679 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:48.441999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:48.442306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:48.443081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:48.444691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:48.456858 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1253/2476] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:48.460931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:48.467366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:48.471090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50988e-c48f-4147-baad-553af008ba1d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:48.476167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:48.477140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:48.477423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:48.477697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] PATH_INFO: `/v3/projects/ea1b01e54d9b4b3b9d1a644072476fad/users/987c32911b9244b38d8c5d6ace52104e/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:48.493243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1b01e54d9b4b3b9d1a644072476fad, user_id=987c32911b9244b38d8c5d6ace52104e, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:48.495968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:48.666501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1224/2477] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:48 2022] PUT /identity/v3/projects/ea1b01e54d9b4b3b9d1a644072476fad/users/987c32911b9244b38d8c5d6ace52104e/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:48.671115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:48.682026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb06879-088a-4e34-a283-d8bbfb1e22ae admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:48.739504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070de36-d584-4f9d-bcf0-0bc88b773092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:48.740104 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070de36-d584-4f9d-bcf0-0bc88b773092 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:48.740408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070de36-d584-4f9d-bcf0-0bc88b773092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:48.740683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070de36-d584-4f9d-bcf0-0bc88b773092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:48.741435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070de36-d584-4f9d-bcf0-0bc88b773092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:48.743055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070de36-d584-4f9d-bcf0-0bc88b773092 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:48.753724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1254/2478] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:48.757918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:48.768815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503dff-44cd-4769-806d-da8419f35cb3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:48.774146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:48.775071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:48.775357 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:48.775634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] PATH_INFO: `/v3/projects/ea1b01e54d9b4b3b9d1a644072476fad/users/987c32911b9244b38d8c5d6ace52104e/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:48.777571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1b01e54d9b4b3b9d1a644072476fad, user_id=987c32911b9244b38d8c5d6ace52104e, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:48.780396 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:48.790537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1225/2479] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:48 2022] PUT /identity/v3/projects/ea1b01e54d9b4b3b9d1a644072476fad/users/987c32911b9244b38d8c5d6ace52104e/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:50.169970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:50.171385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:50.171385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:50.201136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] MFA Rules not processed for user `987c32911b9244b38d8c5d6ace52104e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:50.202306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:50.272875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1255/2480] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:52.290969 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:52.363585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c9942-8900-489f-8768-64acac3cdd11 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:52.369083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:52.369960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:52.370248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:52.370527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] PATH_INFO: `/v3/users/5204571fec794f3d960a098db508f218` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:52.371786 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5204571fec794f3d960a098db508f218)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:52.373727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:52.543675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5204571fec794f3d960a098db508f218'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:52.557905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5204571fec794f3d960a098db508f218'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:52.558581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5204571fec794f3d960a098db508f218'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:52.649464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5204571fec794f3d960a098db508f218'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:52.650103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5204571fec794f3d960a098db508f218'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:52.666427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1226/2481] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:52 2022] DELETE /identity/v3/users/5204571fec794f3d960a098db508f218 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:52.780376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:52.781870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:52.796348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf97c0e-435b-42bd-8e4f-82c68b44a509 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:52.853602 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:52.854468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:52.854788 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:52.855066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] PATH_INFO: `/v3/users/545e4bdf28204020ab2cd8ea6daf5e04` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:52.856242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545e4bdf28204020ab2cd8ea6daf5e04)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:52.858148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:52.862519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:52.936408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:52.938020 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:52.952402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b359e-fe87-4d84-a67d-3f985c1b8a55 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:52.962042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:52.962844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:52.963113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:52.963465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] PATH_INFO: `/v3/projects/3ba12b017e3d4c35ab1044728da1ce6e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:52.964735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba12b017e3d4c35ab1044728da1ce6e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:52.966697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:53.045475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545e4bdf28204020ab2cd8ea6daf5e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.057301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545e4bdf28204020ab2cd8ea6daf5e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.075175 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:53.081100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba12b017e3d4c35ab1044728da1ce6e', 'request_id': 'req-aa35fc5a-7525-4268-84a7-68e58dafcf0f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.087835 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba12b017e3d4c35ab1044728da1ce6e', 'request_id': 'req-aa35fc5a-7525-4268-84a7-68e58dafcf0f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.094221 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba12b017e3d4c35ab1044728da1ce6e', 'request_id': 'req-aa35fc5a-7525-4268-84a7-68e58dafcf0f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.157773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545e4bdf28204020ab2cd8ea6daf5e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.158437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545e4bdf28204020ab2cd8ea6daf5e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.159096 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cc1603c6-edc3-4d19-9a9a-56bf32065757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545e4bdf28204020ab2cd8ea6daf5e04'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.172347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1256/2482] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:52 2022] DELETE /identity/v3/users/545e4bdf28204020ab2cd8ea6daf5e04 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:53.176815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:53.177112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:53.177421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:53.195814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:53.198392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:53.226378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] The token cache is being invalidate because project 3ba12b017e3d4c35ab1044728da1ce6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:53.229819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.229819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.229819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1227/2483] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:52 2022] DELETE /identity/v3/projects/3ba12b017e3d4c35ab1044728da1ce6e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:53.232929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:53.234344 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:53.259364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1257/2484] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:53.269244 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:53.272977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:53.304070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35fc5a-7525-4268-84a7-68e58dafcf0f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:53.308721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:53.309596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:53.309882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:53.310161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] PATH_INFO: `/v3/users/987c32911b9244b38d8c5d6ace52104e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:53.311367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987c32911b9244b38d8c5d6ace52104e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:53.313293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:53.328447 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa42c-cd32-488b-9024-bdd88d54bf2d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:53.332167 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:53.332824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:53.333112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:53.333458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:53.343138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:53.344576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:53.354146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1258/2485] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:41:53.537252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987c32911b9244b38d8c5d6ace52104e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.549432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987c32911b9244b38d8c5d6ace52104e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.550101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987c32911b9244b38d8c5d6ace52104e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.615363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987c32911b9244b38d8c5d6ace52104e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.618740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987c32911b9244b38d8c5d6ace52104e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:53.629270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1228/2486] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:53 2022] DELETE /identity/v3/users/987c32911b9244b38d8c5d6ace52104e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:53.811805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:53.813254 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:53.830136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d7373-0e22-43f8-a93f-c248eb3c22ac service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:53.857309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:53.889138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:53.890005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:53.890308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:53.890572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] PATH_INFO: `/v3/projects/babc010dc2db4090ba1881e81a9a35e2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:53.891809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=babc010dc2db4090ba1881e81a9a35e2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:53.893761 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:53.920768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:53.922403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:53.938135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7f00-3d2e-4c0d-835d-b91d8caec227 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:53.947150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:53.947150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:53.947150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:53.947150 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] PATH_INFO: `/v3/projects/ea1b01e54d9b4b3b9d1a644072476fad` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:53.948374 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1b01e54d9b4b3b9d1a644072476fad)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:53.950382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.020215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babc010dc2db4090ba1881e81a9a35e2', 'request_id': 'req-402dfe80-8fe4-40e3-804a-ab78a6fd3737'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.087223 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:54.091122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1b01e54d9b4b3b9d1a644072476fad', 'request_id': 'req-314adf40-ebc7-4067-ada8-b3043ed64600'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.095185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babc010dc2db4090ba1881e81a9a35e2', 'request_id': 'req-402dfe80-8fe4-40e3-804a-ab78a6fd3737'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.096951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1b01e54d9b4b3b9d1a644072476fad', 'request_id': 'req-314adf40-ebc7-4067-ada8-b3043ed64600'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.102403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babc010dc2db4090ba1881e81a9a35e2', 'request_id': 'req-402dfe80-8fe4-40e3-804a-ab78a6fd3737'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.104001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1b01e54d9b4b3b9d1a644072476fad', 'request_id': 'req-314adf40-ebc7-4067-ada8-b3043ed64600'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.113436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] The token cache is being invalidate because project babc010dc2db4090ba1881e81a9a35e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:54.113733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.114394 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.116071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1259/2487] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:53 2022] DELETE /identity/v3/projects/babc010dc2db4090ba1881e81a9a35e2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:54.119914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:54.121266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:54.174596 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] The token cache is being invalidate because project ea1b01e54d9b4b3b9d1a644072476fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:54.174919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.175554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-314adf40-ebc7-4067-ada8-b3043ed64600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.177302 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1229/2488] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:53 2022] DELETE /identity/v3/projects/ea1b01e54d9b4b3b9d1a644072476fad => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:54.182017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccbd97-a238-4b15-b971-3f43b007fcea None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.182304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccbd97-a238-4b15-b971-3f43b007fcea None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.182585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccbd97-a238-4b15-b971-3f43b007fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.185778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dfe80-8fe4-40e3-804a-ab78a6fd3737 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:54.201348 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dcccbd97-a238-4b15-b971-3f43b007fcea None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:54.204488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dcccbd97-a238-4b15-b971-3f43b007fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:54.247830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:54.248729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.249017 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.249289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] PATH_INFO: `/v3/users/2f901877eb1e4f249c732a5ac1140d66` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.250515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f901877eb1e4f249c732a5ac1140d66)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:54.252480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.264231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1230/2489] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:54.272816 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c84-d517-4373-86a1-eb7a101e9040 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.273246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c84-d517-4373-86a1-eb7a101e9040 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.273528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c84-d517-4373-86a1-eb7a101e9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.292104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cbd95c84-d517-4373-86a1-eb7a101e9040 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:54.293655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cbd95c84-d517-4373-86a1-eb7a101e9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:54.301426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1231/2490] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:54.305880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95c84-d517-4373-86a1-eb7a101e9040 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:54.314623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95c84-d517-4373-86a1-eb7a101e9040 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:54.319446 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:54.320067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.320349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.320622 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.321331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:41:54.321639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:54.323248 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.335151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1232/2491] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:41:54.344747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:54.348289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd7512-8567-4a48-8cd8-a53f63b57747 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:54.353762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:54.354366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.354672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.354956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.355619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:54.357470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.380035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:54.459428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f901877eb1e4f249c732a5ac1140d66'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.472085 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f901877eb1e4f249c732a5ac1140d66'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.478457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1233/2492] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:54 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:54.479485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:54.544030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9cfa0-8f39-491f-8b72-7bed1d2018ad admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:54.548743 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:54.549404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.549690 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.549961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.550703 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:54.552106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f901877eb1e4f249c732a5ac1140d66'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.552935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f901877eb1e4f249c732a5ac1140d66'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.553219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.553634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f901877eb1e4f249c732a5ac1140d66'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:54.566406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1260/2493] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:54 2022] DELETE /identity/v3/users/2f901877eb1e4f249c732a5ac1140d66 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:54.678778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1234/2494] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:54 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:54.687798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:54.687798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:54.747188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe1570-8b5c-4032-a9d7-541e17f8dfae admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:54.751966 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:54.752635 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.752918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.753193 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.753921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:54.756081 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.765845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1261/2495] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:54.769773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:54.780534 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a8b7-afdb-4ab6-bf65-63556ea24465 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:54.785234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5810e06-596e-466a-95db-55033ea38cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:54.785897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810e06-596e-466a-95db-55033ea38cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.786181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810e06-596e-466a-95db-55033ea38cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.786481 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5810e06-596e-466a-95db-55033ea38cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.787781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810e06-596e-466a-95db-55033ea38cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:54.789407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5810e06-596e-466a-95db-55033ea38cbd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.804208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1235/2496] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:54.805409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:54.815723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b331a-1c32-4300-9f52-aaa8d663ace8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:54.822098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:54.824163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.824453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.824731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] PATH_INFO: `/v3/projects/e5194fcfa3214297a21cb288e6f7f3dd/users/12b1cb2e2e9a4e2d8c98d922f8820c8e/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.842466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5194fcfa3214297a21cb288e6f7f3dd, user_id=12b1cb2e2e9a4e2d8c98d922f8820c8e, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:54.844026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:54.930484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1262/2497] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:54 2022] PUT /identity/v3/projects/e5194fcfa3214297a21cb288e6f7f3dd/users/12b1cb2e2e9a4e2d8c98d922f8820c8e/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:54.941775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca83eb6-f656-4da7-9241-a88a7ca084f8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:54.942166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca83eb6-f656-4da7-9241-a88a7ca084f8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:54.942472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca83eb6-f656-4da7-9241-a88a7ca084f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:54.961728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:54.970267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2ca83eb6-f656-4da7-9241-a88a7ca084f8 None None] MFA Rules not processed for user `12b1cb2e2e9a4e2d8c98d922f8820c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:54.971528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ca83eb6-f656-4da7-9241-a88a7ca084f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:55.028571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.030424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:55.037499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1236/2498] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:55.042572 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca83eb6-f656-4da7-9241-a88a7ca084f8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.102885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:55.108004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e877b-778e-4315-9ad1-974efd4e22aa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.112825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.113805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.114154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.114503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] PATH_INFO: `/v3/projects/bafc1724bde74298ba15681f34009a3b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.115859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca83eb6-f656-4da7-9241-a88a7ca084f8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.116171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafc1724bde74298ba15681f34009a3b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.118157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.121576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.122387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.122699 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.122995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.123696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.125666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.219117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1237/2499] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:55 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:55.222825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.242529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafc1724bde74298ba15681f34009a3b', 'request_id': 'req-3ab003c3-8355-405a-b819-5f5f237ff3e5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:55.287936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fe150-a265-406f-ba87-507b26e24e00 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.293235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.293992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.294281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.294561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.295308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.297249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.352360 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafc1724bde74298ba15681f34009a3b', 'request_id': 'req-3ab003c3-8355-405a-b819-5f5f237ff3e5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:55.359101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafc1724bde74298ba15681f34009a3b', 'request_id': 'req-3ab003c3-8355-405a-b819-5f5f237ff3e5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:55.370936 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] The token cache is being invalidate because project bafc1724bde74298ba15681f34009a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:55.371229 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:55.372017 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ab003c3-8355-405a-b819-5f5f237ff3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:55.373669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1263/2500] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:55 2022] DELETE /identity/v3/projects/bafc1724bde74298ba15681f34009a3b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:55.378591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3a21-1bb5-42b9-a7a9-eb2e00d8e784 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.378864 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3a21-1bb5-42b9-a7a9-eb2e00d8e784 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.379150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3a21-1bb5-42b9-a7a9-eb2e00d8e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.398671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-97dc3a21-1bb5-42b9-a7a9-eb2e00d8e784 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:55.399892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97dc3a21-1bb5-42b9-a7a9-eb2e00d8e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:55.408140 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1264/2501] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:55.416273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c341ed-2c10-456a-afa5-24d15cc267d5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.416565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c341ed-2c10-456a-afa5-24d15cc267d5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.416846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c341ed-2c10-456a-afa5-24d15cc267d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.427063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1238/2502] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:55 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:55.431178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.432871 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:55.435533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f9c341ed-2c10-456a-afa5-24d15cc267d5 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:55.436682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9c341ed-2c10-456a-afa5-24d15cc267d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:55.450744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1265/2503] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:55.451189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d9ab9-43ef-41d4-b79f-373a06348433 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.452238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c341ed-2c10-456a-afa5-24d15cc267d5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.452737 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.453532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.453858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.454148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.454858 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.456457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.462992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c341ed-2c10-456a-afa5-24d15cc267d5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.467490 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.467638 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1239/2504] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:41:55.468132 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.468414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.468686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.469435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:41:55.469738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.471424 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.471611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.481426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae31a3-437d-492b-9021-62fde3d10712 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.483588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1266/2505] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:41:55.486309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.487225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.487555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.487687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.487833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] PATH_INFO: `/v3/projects/fb0fc3ab43c74f5484ec46f4bdf3c934/users/cf72a3dd012947b1ae30db6373c40464/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.500785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47c66-a7fd-42cc-b265-03ef0e510767 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.503900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0fc3ab43c74f5484ec46f4bdf3c934, user_id=cf72a3dd012947b1ae30db6373c40464, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.506071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.507262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.507498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.507621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.507805 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.508493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.510372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.604247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1240/2506] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:55 2022] PUT /identity/v3/projects/fb0fc3ab43c74f5484ec46f4bdf3c934/users/cf72a3dd012947b1ae30db6373c40464/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:55.608245 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.622582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:55.632290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1267/2507] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:55 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:41:55.633460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.675668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518fa9-8620-4499-8bea-f27bb2bd8d7e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.699018 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af53da-fc2d-4c26-8004-29774c78dd83 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.703968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.704579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.704865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.705144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.705828 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.707781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.733037 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.733717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.734005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.734284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.735061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.736654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.747866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1241/2508] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:41:55.758239 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.768062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6e78-04d8-4055-916d-b79469fe4bdf admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.773021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b25cb-cf3f-441f-a077-39aa9a552c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.773899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b25cb-cf3f-441f-a077-39aa9a552c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.774182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b25cb-cf3f-441f-a077-39aa9a552c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.774456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b25cb-cf3f-441f-a077-39aa9a552c3f admin admin] PATH_INFO: `/v3/projects/fb0fc3ab43c74f5484ec46f4bdf3c934/users/cf72a3dd012947b1ae30db6373c40464/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.776505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b25cb-cf3f-441f-a077-39aa9a552c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0fc3ab43c74f5484ec46f4bdf3c934, user_id=cf72a3dd012947b1ae30db6373c40464, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.779201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b25cb-cf3f-441f-a077-39aa9a552c3f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.790049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1242/2509] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:55 2022] PUT /identity/v3/projects/fb0fc3ab43c74f5484ec46f4bdf3c934/users/cf72a3dd012947b1ae30db6373c40464/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:55.800313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.800704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.801022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.824430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1268/2510] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:55 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:55.828306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.830070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] MFA Rules not processed for user `cf72a3dd012947b1ae30db6373c40464`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:55.831330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:55.839547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4698ca-946c-40cb-946a-b9deab7e3aa4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.868764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:55.903993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.904705 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.904992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.905278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.906013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.907639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.908583 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:55.909268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1243/2511] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:55.921214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1269/2512] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:41:55.921401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.921713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:55.922205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.932530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c05d1-e52e-446a-b89e-1fb5e041c453 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.937231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.937880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.938163 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.938439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.939195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.940789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.955477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1270/2513] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:55.956725 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:55.966754 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2675-c94a-4cb4-8fed-ae25b4fd681c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.971563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.972682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.972972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.973306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] PATH_INFO: `/v3/projects/42e70f765cd54b7996746fd4d39d97dd/users/d75985e9449341ba9a7e5febd796d170/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.979842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82068e81-acc1-49fa-89fc-4e8cd390ba9d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:55.983543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e807fe0-04ef-466b-87ca-70c417cfeb94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:55.984193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e807fe0-04ef-466b-87ca-70c417cfeb94 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:55.984476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e807fe0-04ef-466b-87ca-70c417cfeb94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:55.984755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e807fe0-04ef-466b-87ca-70c417cfeb94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:55.988368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e70f765cd54b7996746fd4d39d97dd, user_id=d75985e9449341ba9a7e5febd796d170, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.991185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:55.994002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e807fe0-04ef-466b-87ca-70c417cfeb94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:55.995473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e807fe0-04ef-466b-87ca-70c417cfeb94 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:56.005054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1244/2514] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:56.107220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1271/2515] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:55 2022] PUT /identity/v3/projects/42e70f765cd54b7996746fd4d39d97dd/users/d75985e9449341ba9a7e5febd796d170/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:56.117759 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79f45-0ea7-4d4d-966e-a0b675d59788 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.118077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79f45-0ea7-4d4d-966e-a0b675d59788 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.118354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec79f45-0ea7-4d4d-966e-a0b675d59788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.147780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-eec79f45-0ea7-4d4d-966e-a0b675d59788 None None] MFA Rules not processed for user `d75985e9449341ba9a7e5febd796d170`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:56.149030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-eec79f45-0ea7-4d4d-966e-a0b675d59788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:56.217144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1245/2516] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:41:56.221600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:56.288068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7eaa-b5c1-4c8a-b805-0bd719bbd71f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:56.293181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:56.293893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.299390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.299390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.299390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:56.299390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:56.421498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1272/2517] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:56 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:56.422972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec79f45-0ea7-4d4d-966e-a0b675d59788 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:56.434317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec79f45-0ea7-4d4d-966e-a0b675d59788 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:56.492314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:56.492921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.493212 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.493491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.494195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:56.496181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:56.588543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1246/2518] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:56 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:56.591563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:56.602657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc758d9d-edd8-434f-92c6-3c16f58186db admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:56.607263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:56.607959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.608247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.608524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.609246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:56.610875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:56.622275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1273/2519] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:56.626523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:56.636993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f769b3-185e-4713-8f17-8948d34d4a15 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:56.641613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:56.642505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.642826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.646491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] PATH_INFO: `/v3/projects/5403363726594e38a0b5d314ea068830/users/d35d448e8dd64761b76f7cd5a4602d2f/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.656325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:56.659614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5403363726594e38a0b5d314ea068830, user_id=d35d448e8dd64761b76f7cd5a4602d2f, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:56.663077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:56.769331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1247/2520] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:56 2022] PUT /identity/v3/projects/5403363726594e38a0b5d314ea068830/users/d35d448e8dd64761b76f7cd5a4602d2f/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:56.774345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:56.784515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a7a74-b64d-4cb2-a38b-0b08f15f8cf1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:56.844401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fc8b6-c59e-4e76-aeb8-734a08d61147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:56.845071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fc8b6-c59e-4e76-aeb8-734a08d61147 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.845352 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fc8b6-c59e-4e76-aeb8-734a08d61147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.845626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fc8b6-c59e-4e76-aeb8-734a08d61147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.846354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fc8b6-c59e-4e76-aeb8-734a08d61147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:56.847993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fc8b6-c59e-4e76-aeb8-734a08d61147 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:56.850314 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:56.858428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1274/2521] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:41:56.862766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:56.873024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2e25-7df7-4663-8f51-00bc730d2bc2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:56.877631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:56.878508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.878825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.879110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] PATH_INFO: `/v3/projects/5403363726594e38a0b5d314ea068830/users/d35d448e8dd64761b76f7cd5a4602d2f/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.881635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5403363726594e38a0b5d314ea068830, user_id=d35d448e8dd64761b76f7cd5a4602d2f, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:56.884310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:56.894389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1248/2522] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:41:56 2022] PUT /identity/v3/projects/5403363726594e38a0b5d314ea068830/users/d35d448e8dd64761b76f7cd5a4602d2f/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:56.906099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a577e4-5400-4104-a73d-45d41e0e676d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:56.906389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a577e4-5400-4104-a73d-45d41e0e676d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:56.906686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a577e4-5400-4104-a73d-45d41e0e676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:56.937182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-15a577e4-5400-4104-a73d-45d41e0e676d None None] MFA Rules not processed for user `d35d448e8dd64761b76f7cd5a4602d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:56.938416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-15a577e4-5400-4104-a73d-45d41e0e676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:57.015330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1275/2523] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:57.027276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:57.039289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a577e4-5400-4104-a73d-45d41e0e676d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:57.104958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da7b66-0469-4640-96c1-52c3dd916bfb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:57.108917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:57.109082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a577e4-5400-4104-a73d-45d41e0e676d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:57.109630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:57.111787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:57.111787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:57.113524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:57.114393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:57.115252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:57.115689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] PATH_INFO: `/v3/users/12b1cb2e2e9a4e2d8c98d922f8820c8e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:57.116953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b1cb2e2e9a4e2d8c98d922f8820c8e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:57.118902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:57.120559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:57.122067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:57.133418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1249/2524] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:57.252232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:57.253611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:57.265910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145c9e-3234-4256-bcee-f2c9a30881be service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:57.269522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe235-11d0-477e-9109-1e3fd6c4d6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:57.270144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe235-11d0-477e-9109-1e3fd6c4d6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:57.270423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe235-11d0-477e-9109-1e3fd6c4d6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:57.270732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe235-11d0-477e-9109-1e3fd6c4d6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:57.322008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b1cb2e2e9a4e2d8c98d922f8820c8e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:57.330715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbe235-11d0-477e-9109-1e3fd6c4d6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:57.332439 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbe235-11d0-477e-9109-1e3fd6c4d6c9 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:57.338572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b1cb2e2e9a4e2d8c98d922f8820c8e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:57.342782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1250/2525] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:41:57.392274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b1cb2e2e9a4e2d8c98d922f8820c8e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:57.393919 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b1cb2e2e9a4e2d8c98d922f8820c8e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:57.394817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b1cb2e2e9a4e2d8c98d922f8820c8e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:57.419669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1276/2526] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:57 2022] DELETE /identity/v3/users/12b1cb2e2e9a4e2d8c98d922f8820c8e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:41:57.422035 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:57.422370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:57.422889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:57.445509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:57.446888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:57.515177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1251/2527] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:57.525138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:57.527324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:57.533136 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:57.591270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e0440-9495-405f-8996-a5404ec2752a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:57.595645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:57.596401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:57.596684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:57.596963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:57.606971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:57.608397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:57.618722 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1277/2528] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:58.166892 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:58.168719 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:58.181132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfcabe-0e53-4bde-85bc-7a737698e7b8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:58.185945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:58.186842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:58.187125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:58.187399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] PATH_INFO: `/v3/projects/e5194fcfa3214297a21cb288e6f7f3dd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:58.188581 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5194fcfa3214297a21cb288e6f7f3dd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:58.190472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:58.210314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:58.327826 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:58.330680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:58.335603 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5194fcfa3214297a21cb288e6f7f3dd', 'request_id': 'req-4f67a968-506f-4ae7-ac75-9deed4a00e43'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.347204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5194fcfa3214297a21cb288e6f7f3dd', 'request_id': 'req-4f67a968-506f-4ae7-ac75-9deed4a00e43'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.354832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5194fcfa3214297a21cb288e6f7f3dd', 'request_id': 'req-4f67a968-506f-4ae7-ac75-9deed4a00e43'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.428538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0b40-826f-4f43-98ed-863257f89ec3 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:58.458124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] The token cache is being invalidate because project e5194fcfa3214297a21cb288e6f7f3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:58.459459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.460514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.474774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1252/2529] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:58 2022] DELETE /identity/v3/projects/e5194fcfa3214297a21cb288e6f7f3dd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:58.476184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:58.478989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:58.535185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:58.537708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:58.540546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:58.541112 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:58.543957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:58.559931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:58.561901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:58.575476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1278/2530] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:41:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:41:58.581576 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a968-506f-4ae7-ac75-9deed4a00e43 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:58.596295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:58.597338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:58.597628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:58.597908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] PATH_INFO: `/v3/users/cf72a3dd012947b1ae30db6373c40464` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:58.600204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf72a3dd012947b1ae30db6373c40464)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:58.603422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:58.783961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf72a3dd012947b1ae30db6373c40464'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.797517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf72a3dd012947b1ae30db6373c40464'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.798468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf72a3dd012947b1ae30db6373c40464'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.860801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf72a3dd012947b1ae30db6373c40464'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.861877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ec9be5f8-b619-4aae-925c-d334e1f1224e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf72a3dd012947b1ae30db6373c40464'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:58.874915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1253/2531] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:41:58 2022] DELETE /identity/v3/users/cf72a3dd012947b1ae30db6373c40464 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:59.288573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:59.312821 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc64d13-0435-42a4-b241-fe6b694bc6ef service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:59.363435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:59.412272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:59.413280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:59.413709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:59.414010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] PATH_INFO: `/v3/projects/fb0fc3ab43c74f5484ec46f4bdf3c934` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:59.415470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0fc3ab43c74f5484ec46f4bdf3c934)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:59.417860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:59.527341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0fc3ab43c74f5484ec46f4bdf3c934', 'request_id': 'req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:59.625545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0fc3ab43c74f5484ec46f4bdf3c934', 'request_id': 'req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:59.631834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0fc3ab43c74f5484ec46f4bdf3c934', 'request_id': 'req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:59.643228 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] The token cache is being invalidate because project fb0fc3ab43c74f5484ec46f4bdf3c934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:41:59.643452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:59.644103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66a7ab1c-2fe0-4168-ba2b-85acd4441ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:41:59.645639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1279/2532] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:41:59 2022] DELETE /identity/v3/projects/fb0fc3ab43c74f5484ec46f4bdf3c934 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:41:59.651182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf050dc-bf10-4b60-b675-10d6485cced9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:59.651732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf050dc-bf10-4b60-b675-10d6485cced9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:59.651840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf050dc-bf10-4b60-b675-10d6485cced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:59.671092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2cf050dc-bf10-4b60-b675-10d6485cced9 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:59.672293 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2cf050dc-bf10-4b60-b675-10d6485cced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:59.689160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:59.733352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1254/2533] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:59.741390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92bde-2c1c-4f12-bc71-71d656052fcb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:59.741689 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92bde-2c1c-4f12-bc71-71d656052fcb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:59.741974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c92bde-2c1c-4f12-bc71-71d656052fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:59.767572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f9c92bde-2c1c-4f12-bc71-71d656052fcb None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:41:59.767572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9c92bde-2c1c-4f12-bc71-71d656052fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:41:59.775070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1280/2534] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:41:59.779696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf050dc-bf10-4b60-b675-10d6485cced9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:59.789809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf050dc-bf10-4b60-b675-10d6485cced9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:59.795435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:59.795586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:59.795914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:59.796217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:59.796985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:41:59.797331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:59.798973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:59.811030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1255/2535] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:41:59.815309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c92bde-2c1c-4f12-bc71-71d656052fcb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:59.825264 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c92bde-2c1c-4f12-bc71-71d656052fcb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:41:59.830160 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:41:59.830910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:41:59.831201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:41:59.831483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:41:59.832178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:41:59.834785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:41:59.942338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1281/2536] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:41:59 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:41:59.947091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:41:59.957063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722f2f2-e2ac-4c5d-9e52-1de2fa81b3fa admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.016483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.017106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.017395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.017680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.018383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.020536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.098996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1256/2537] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:41:59 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:00.100408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.111432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fcb27-8b70-4bf4-9f01-75f56e59f6f0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.116929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.117604 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.117925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.118203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.118982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.120636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.133425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1282/2538] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:00.137782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.148465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0cea2-e525-434d-884a-f07a1581f2b0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.153126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f62c25-3d59-4654-912a-c137507a4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.158098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f62c25-3d59-4654-912a-c137507a4834 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.158098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f62c25-3d59-4654-912a-c137507a4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.158098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f62c25-3d59-4654-912a-c137507a4834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.158098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f62c25-3d59-4654-912a-c137507a4834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.158098 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f62c25-3d59-4654-912a-c137507a4834 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.167112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1257/2539] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:00.171624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.182367 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da73a5-ccd2-4b6c-bddf-331cf8d31fd1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.187060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.187971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.188249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.188522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] PATH_INFO: `/v3/projects/3774c8f6ff4d41099d02a46002e70bfa/users/ac49f22623f9471ebc40a3e95ef76304/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.203528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3774c8f6ff4d41099d02a46002e70bfa, user_id=ac49f22623f9471ebc40a3e95ef76304, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.206119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.335075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1283/2540] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:00 2022] PUT /identity/v3/projects/3774c8f6ff4d41099d02a46002e70bfa/users/ac49f22623f9471ebc40a3e95ef76304/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:00.346517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbae00-7bc4-4528-98f5-3789e1d2171a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.346917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbae00-7bc4-4528-98f5-3789e1d2171a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.347114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbae00-7bc4-4528-98f5-3789e1d2171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.375996 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-efdbae00-7bc4-4528-98f5-3789e1d2171a None None] MFA Rules not processed for user `ac49f22623f9471ebc40a3e95ef76304`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:00.377217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-efdbae00-7bc4-4528-98f5-3789e1d2171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:00.444399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1258/2541] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:00.448820 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.509730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:00.515227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec466f9-922f-4216-adfd-fa9396e85197 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.520143 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.520928 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.521608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.521738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.522562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.524613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.596568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1284/2542] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:00 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:00.597957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbae00-7bc4-4528-98f5-3789e1d2171a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.611706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbae00-7bc4-4528-98f5-3789e1d2171a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.627425 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:00.683925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.684651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.684887 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.685162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.685866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.687851 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.787449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1259/2543] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:00 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:00.791729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.809815 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdc566-1407-44fe-8c5a-05bccffb6b93 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.814784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.815500 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.815792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.816074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.816822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.818713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.832448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1285/2544] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:00.835290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.845609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d6ad0-7662-45bc-b96d-16073bfe257f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:00.851101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:00.852031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:00.852327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:00.852612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] PATH_INFO: `/v3/projects/3047750971d84089a092ab13b701e7be/users/b4310a38b2824352bc0f5fc5f68c70f3/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:00.868390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3047750971d84089a092ab13b701e7be, user_id=b4310a38b2824352bc0f5fc5f68c70f3, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:00.871114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:00.969546 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1260/2545] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:00 2022] PUT /identity/v3/projects/3047750971d84089a092ab13b701e7be/users/b4310a38b2824352bc0f5fc5f68c70f3/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:00.973690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:00.984900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d530ae0-89d0-46fb-bf63-161eb6c508a3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:01.044089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74a199-2aa2-49e3-a6e5-8daa3f97f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:01.045011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74a199-2aa2-49e3-a6e5-8daa3f97f268 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:01.045293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74a199-2aa2-49e3-a6e5-8daa3f97f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:01.045568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74a199-2aa2-49e3-a6e5-8daa3f97f268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:01.046293 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74a199-2aa2-49e3-a6e5-8daa3f97f268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:01.048399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74a199-2aa2-49e3-a6e5-8daa3f97f268 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:01.065321 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1286/2546] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:01.066738 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:01.078725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa0781-19f8-4971-9a7e-ab61020a6cb5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:01.088177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:01.088177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:01.088177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:01.088177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] PATH_INFO: `/v3/projects/3047750971d84089a092ab13b701e7be/users/b4310a38b2824352bc0f5fc5f68c70f3/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:01.089250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3047750971d84089a092ab13b701e7be, user_id=b4310a38b2824352bc0f5fc5f68c70f3, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:01.090599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:01.111792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1261/2547] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:01 2022] PUT /identity/v3/projects/3047750971d84089a092ab13b701e7be/users/b4310a38b2824352bc0f5fc5f68c70f3/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:01.114770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939fba-ac65-4cbe-a6bd-5ff70fc8420b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:01.115133 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939fba-ac65-4cbe-a6bd-5ff70fc8420b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:01.116747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af939fba-ac65-4cbe-a6bd-5ff70fc8420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:01.153234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-af939fba-ac65-4cbe-a6bd-5ff70fc8420b None None] MFA Rules not processed for user `b4310a38b2824352bc0f5fc5f68c70f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:01.154445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af939fba-ac65-4cbe-a6bd-5ff70fc8420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:01.233442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1287/2548] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:01.242144 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:01.244102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:01.306688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21777b9-39b6-4deb-98db-17b48f0a9e5c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:01.316210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37701ff-edb1-4d81-a91e-c584c59d8390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:01.316210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37701ff-edb1-4d81-a91e-c584c59d8390 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:01.316210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37701ff-edb1-4d81-a91e-c584c59d8390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:01.316210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37701ff-edb1-4d81-a91e-c584c59d8390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:01.325823 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37701ff-edb1-4d81-a91e-c584c59d8390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:01.327752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37701ff-edb1-4d81-a91e-c584c59d8390 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:01.341428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1262/2549] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:01.584053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af939fba-ac65-4cbe-a6bd-5ff70fc8420b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:01.637677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:01.649345 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af939fba-ac65-4cbe-a6bd-5ff70fc8420b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:01.653856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:01.654762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:01.655049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:01.655326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] PATH_INFO: `/v3/users/ac49f22623f9471ebc40a3e95ef76304` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:01.656513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac49f22623f9471ebc40a3e95ef76304)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:01.658429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:01.904309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac49f22623f9471ebc40a3e95ef76304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:01.918141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac49f22623f9471ebc40a3e95ef76304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.031863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac49f22623f9471ebc40a3e95ef76304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.032584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac49f22623f9471ebc40a3e95ef76304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.033282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac49f22623f9471ebc40a3e95ef76304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.047596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1288/2550] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:01 2022] DELETE /identity/v3/users/ac49f22623f9471ebc40a3e95ef76304 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:02.053011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:02.053644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:02.053811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:02.071502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:02.072729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:02.137270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1263/2551] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:02.147183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:02.148703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:02.207048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046210-b082-4ec2-a8e0-64fefdab61db admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:02.210759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:02.211410 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:02.211704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:02.212074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:02.221073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:02.222503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:02.232888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1289/2552] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:02.402843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:02.404304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:02.416895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61c53-6e30-41f5-809f-f5871b5e3286 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:02.421838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:02.422748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:02.423036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:02.423315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] PATH_INFO: `/v3/users/d75985e9449341ba9a7e5febd796d170` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:02.424513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75985e9449341ba9a7e5febd796d170)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:02.426473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:02.445817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:02.674985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75985e9449341ba9a7e5febd796d170'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.684204 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75985e9449341ba9a7e5febd796d170'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.684905 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75985e9449341ba9a7e5febd796d170'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.706199 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:02.707655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:02.724910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e99886-f983-45c6-82f3-e4ba2a023d36 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:02.734217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:02.734217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:02.734217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:02.734217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] PATH_INFO: `/v3/projects/3774c8f6ff4d41099d02a46002e70bfa` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:02.738573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3774c8f6ff4d41099d02a46002e70bfa)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:02.738573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:02.780775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75985e9449341ba9a7e5febd796d170'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.781747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4bc0fa27-0655-4621-b842-bc7d4f7344c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75985e9449341ba9a7e5febd796d170'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.794984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1264/2553] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:02 2022] DELETE /identity/v3/users/d75985e9449341ba9a7e5febd796d170 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:02.799371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:02.799663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:02.799943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:02.816756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:02.818748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:02.878684 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1265/2554] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:02.889252 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:02.890676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:02.898220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3774c8f6ff4d41099d02a46002e70bfa', 'request_id': 'req-31317ba9-9981-4823-8978-80ae32d08e81'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.951282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ed8d-4b7d-40bb-a6b4-ee1ed1abd32c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:02.956988 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3774c8f6ff4d41099d02a46002e70bfa', 'request_id': 'req-31317ba9-9981-4823-8978-80ae32d08e81'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.965584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3774c8f6ff4d41099d02a46002e70bfa', 'request_id': 'req-31317ba9-9981-4823-8978-80ae32d08e81'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.978105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:02.987427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] The token cache is being invalidate because project 3774c8f6ff4d41099d02a46002e70bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:02.987427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.987427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:02.987427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1290/2555] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:02 2022] DELETE /identity/v3/projects/3774c8f6ff4d41099d02a46002e70bfa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:02.987427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:02.988124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:02.997891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:03.008284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:03.012393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:03.012393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:03.012393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:03.012393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:03.054320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317ba9-9981-4823-8978-80ae32d08e81 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:03.059399 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:03.060484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:03.060969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:03.061252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] PATH_INFO: `/v3/users/b4310a38b2824352bc0f5fc5f68c70f3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:03.063195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4310a38b2824352bc0f5fc5f68c70f3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:03.065164 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:03.079688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:03.081707 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:03.092238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1266/2556] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:03.319108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4310a38b2824352bc0f5fc5f68c70f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.331355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4310a38b2824352bc0f5fc5f68c70f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.455024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4310a38b2824352bc0f5fc5f68c70f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.455579 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4310a38b2824352bc0f5fc5f68c70f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.456214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4310a38b2824352bc0f5fc5f68c70f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.469583 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1291/2557] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:02 2022] DELETE /identity/v3/users/b4310a38b2824352bc0f5fc5f68c70f3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:03.534443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:03.536122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:03.559640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b7a14-c053-49d8-8792-3c5d9382f27d service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:03.624762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:03.625665 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:03.625966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:03.626257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] PATH_INFO: `/v3/projects/42e70f765cd54b7996746fd4d39d97dd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:03.627553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e70f765cd54b7996746fd4d39d97dd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:03.629492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:03.753188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e70f765cd54b7996746fd4d39d97dd', 'request_id': 'req-46d46700-2132-44fa-a942-611f0a5b94e4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.759782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e70f765cd54b7996746fd4d39d97dd', 'request_id': 'req-46d46700-2132-44fa-a942-611f0a5b94e4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.766067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e70f765cd54b7996746fd4d39d97dd', 'request_id': 'req-46d46700-2132-44fa-a942-611f0a5b94e4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.833188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] The token cache is being invalidate because project 42e70f765cd54b7996746fd4d39d97dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:03.834182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.835069 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:03.836833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1267/2558] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:03 2022] DELETE /identity/v3/projects/42e70f765cd54b7996746fd4d39d97dd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:03.840786 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:03.842342 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:03.856433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6387ab-e573-46bf-b976-befaa94a81f7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:03.913190 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:03.914201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:03.914563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:03.914878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] PATH_INFO: `/v3/users/d35d448e8dd64761b76f7cd5a4602d2f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:03.916110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35d448e8dd64761b76f7cd5a4602d2f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:03.918306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:03.932250 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:03.934267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:03.945670 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:03.949452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46700-2132-44fa-a942-611f0a5b94e4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:03.955405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:03.955405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:03.955405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:03.955704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] PATH_INFO: `/v3/projects/3047750971d84089a092ab13b701e7be` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:03.956856 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3047750971d84089a092ab13b701e7be)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:03.959640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:03.979310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:04.137243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3047750971d84089a092ab13b701e7be', 'request_id': 'req-d21d7351-1721-4b4c-ad93-636ccd033745'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.137915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35d448e8dd64761b76f7cd5a4602d2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.142746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3047750971d84089a092ab13b701e7be', 'request_id': 'req-d21d7351-1721-4b4c-ad93-636ccd033745'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.150508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3047750971d84089a092ab13b701e7be', 'request_id': 'req-d21d7351-1721-4b4c-ad93-636ccd033745'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.150697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35d448e8dd64761b76f7cd5a4602d2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.203034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35d448e8dd64761b76f7cd5a4602d2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.203963 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35d448e8dd64761b76f7cd5a4602d2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.204750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35d448e8dd64761b76f7cd5a4602d2f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.218411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1292/2559] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:03 2022] DELETE /identity/v3/users/d35d448e8dd64761b76f7cd5a4602d2f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:04.219170 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.220492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:04.256022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] The token cache is being invalidate because project 3047750971d84089a092ab13b701e7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:04.257018 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.257339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d21d7351-1721-4b4c-ad93-636ccd033745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.259406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1268/2560] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:03 2022] DELETE /identity/v3/projects/3047750971d84089a092ab13b701e7be => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:04.263992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9454f-bf68-41ad-b450-1a2dd4a14a8b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.264409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9454f-bf68-41ad-b450-1a2dd4a14a8b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.264785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9454f-bf68-41ad-b450-1a2dd4a14a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.284965 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add07e2-aa86-4034-8543-4e36e9dbde70 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.285484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d9f9454f-bf68-41ad-b450-1a2dd4a14a8b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:04.286964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d9f9454f-bf68-41ad-b450-1a2dd4a14a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:04.289977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.290720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.291012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.291385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.293889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:04.351527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1269/2561] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:04.358981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12343-f89a-4fb8-9e5a-30b015999e3e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.359272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12343-f89a-4fb8-9e5a-30b015999e3e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.359558 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12343-f89a-4fb8-9e5a-30b015999e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.364270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.366737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:04.376803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1293/2562] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:04.379431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e0a12343-f89a-4fb8-9e5a-30b015999e3e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:04.381289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e0a12343-f89a-4fb8-9e5a-30b015999e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:04.390677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1270/2563] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:04.393581 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.403924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759047f1-4175-4155-a3ca-c96a745e99bb service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.408703 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.409361 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.409648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.412708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.412708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:04.412708 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.413036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:04.426810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1294/2564] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:04.430430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a12343-f89a-4fb8-9e5a-30b015999e3e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.440116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a12343-f89a-4fb8-9e5a-30b015999e3e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.445967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.446682 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.446971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.447249 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.447977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.450158 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:04.597475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1271/2565] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:04 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:04.598979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.610249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba38974-248f-4d68-8181-f5f44b930402 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.645169 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:04.675755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.676563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.676917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.677306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.678243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.680269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:04.726868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.728624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:04.747112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7be32-6a30-4513-92f6-b881d122e520 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.752535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.753487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.753662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.753960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] PATH_INFO: `/v3/projects/5403363726594e38a0b5d314ea068830` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.755442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5403363726594e38a0b5d314ea068830)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.764442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:04.821511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1295/2566] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:04 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:04.825455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.836429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8974c-1063-4d4e-b2f9-b1ad8e48a77c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.841884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.842527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.842843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.843125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.843849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.845446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:04.856527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1296/2567] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:04.860645 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.870691 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66095b9a-c6a8-43cf-a363-d719ca6b56d5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.875268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.875911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.876219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.876550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.877269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.878888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:04.892166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1297/2568] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:04.893493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:04.905246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccdd23-f490-439c-aca8-e88cc4f09093 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:04.918757 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5403363726594e38a0b5d314ea068830', 'request_id': 'req-5134d3a8-bece-4d65-be98-d05224ef1d4d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.925927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5403363726594e38a0b5d314ea068830', 'request_id': 'req-5134d3a8-bece-4d65-be98-d05224ef1d4d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.933271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5403363726594e38a0b5d314ea068830', 'request_id': 'req-5134d3a8-bece-4d65-be98-d05224ef1d4d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:04.965731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5b07-5432-465e-8986-593554425f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:04.966687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5b07-5432-465e-8986-593554425f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:04.966978 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5b07-5432-465e-8986-593554425f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:04.967256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5b07-5432-465e-8986-593554425f53 admin admin] PATH_INFO: `/v3/projects/90855c2b077b4e0289833ee059c0a3df/users/b5a37a82bf9f4f1f86a09f005aae6063/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:04.981618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5b07-5432-465e-8986-593554425f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90855c2b077b4e0289833ee059c0a3df, user_id=b5a37a82bf9f4f1f86a09f005aae6063, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:04.984302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5b07-5432-465e-8986-593554425f53 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.016804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:05.020733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] The token cache is being invalidate because project 5403363726594e38a0b5d314ea068830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:05.021662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:05.022369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5134d3a8-bece-4d65-be98-d05224ef1d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:05.024011 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1272/2569] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:04 2022] DELETE /identity/v3/projects/5403363726594e38a0b5d314ea068830 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:05.028679 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185577f9-f0c8-4449-98ce-300eff995d4e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.028953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185577f9-f0c8-4449-98ce-300eff995d4e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.029238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185577f9-f0c8-4449-98ce-300eff995d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.047693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-185577f9-f0c8-4449-98ce-300eff995d4e None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:05.048984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-185577f9-f0c8-4449-98ce-300eff995d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:05.065206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1273/2570] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:05.074271 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e869-a17a-4f7b-b582-0e97d89f6878 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.074561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e869-a17a-4f7b-b582-0e97d89f6878 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.075353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79e869-a17a-4f7b-b582-0e97d89f6878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.092016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1298/2571] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:04 2022] PUT /identity/v3/projects/90855c2b077b4e0289833ee059c0a3df/users/b5a37a82bf9f4f1f86a09f005aae6063/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:05.094491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2e79e869-a17a-4f7b-b582-0e97d89f6878 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:05.095746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2e79e869-a17a-4f7b-b582-0e97d89f6878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:05.103005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.103301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.103594 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.133395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] MFA Rules not processed for user `b5a37a82bf9f4f1f86a09f005aae6063`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:05.134999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:05.160649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1274/2572] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:05.164652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e869-a17a-4f7b-b582-0e97d89f6878 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.175538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79e869-a17a-4f7b-b582-0e97d89f6878 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.180597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.181262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.181843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.181843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.182881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:05.183191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.185026 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.202630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1275/2573] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:42:05.203919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.214895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1299/2574] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:05.215499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2456-ebef-4770-ae3f-0325de8ba7e8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.219230 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.220888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:05.221030 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.221696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.222029 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.222379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.223492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.225639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.235114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8f20-3534-4021-afee-ffc2ec775e1e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.243758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.244478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.244785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.245100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.245796 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.247780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.257686 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:05.330627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1276/2575] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:05.335046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.371550 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1300/2576] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:05.375587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.423802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3fa8f-9b52-49b6-a47f-a2a8f56d65c2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.477296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0c98c-94c9-49b6-a076-cd4b2ce39648 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.483662 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.484356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.484639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.485906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.486634 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.489284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.520804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.521855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.522211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.522561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.523403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.525426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.536595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:05.571288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1301/2577] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:05.575481 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.587623 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88cfa6-09f6-40b5-a333-122663548703 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.592773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.593445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.593734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.597336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.597336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.597336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.608401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1302/2578] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:05.612466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.623324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81b75-6afa-4067-a2a5-f6d5742325d1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.624055 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1277/2579] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:05.629166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.631711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.632824 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.633285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.633727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] PATH_INFO: `/v3/projects/e46fd877e91947588ddf7e26cd465e59/users/82f3507ffb2448ee86436e95b803dbd6/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.640997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e147b5e-7490-4a0b-ab2e-77db19605024 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.646363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.647075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.647376 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.647656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.648398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.650074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.652554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46fd877e91947588ddf7e26cd465e59, user_id=82f3507ffb2448ee86436e95b803dbd6, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.655484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.660449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1278/2580] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:05.665129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.676235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27123c1-9db2-4e4c-9732-a7f3a58fa05c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.682059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.682755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.683043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.683327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.684058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.685653 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.696208 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1279/2581] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:05.700238 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.711611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d55f-8b73-466d-a8a2-8d7db4e19bfd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.716497 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418002a-c103-4a42-b0a7-c6d84e3238b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.717411 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418002a-c103-4a42-b0a7-c6d84e3238b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.717689 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418002a-c103-4a42-b0a7-c6d84e3238b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.717964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418002a-c103-4a42-b0a7-c6d84e3238b7 admin admin] PATH_INFO: `/v3/projects/20088af291444ccea67778274f6e31f0/users/5f18f260b4ce40598360e665d7ac3189/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.731355 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1303/2582] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:05 2022] PUT /identity/v3/projects/e46fd877e91947588ddf7e26cd465e59/users/82f3507ffb2448ee86436e95b803dbd6/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:05.735972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.737090 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418002a-c103-4a42-b0a7-c6d84e3238b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20088af291444ccea67778274f6e31f0, user_id=5f18f260b4ce40598360e665d7ac3189, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.741390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418002a-c103-4a42-b0a7-c6d84e3238b7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.803434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09094d3e-3496-4026-b76a-0a296ff81f15 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.808482 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.809157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.809441 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.809723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.810593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.812430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.816750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1280/2583] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:05 2022] PUT /identity/v3/projects/20088af291444ccea67778274f6e31f0/users/5f18f260b4ce40598360e665d7ac3189/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:05.829221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1304/2584] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:05.829406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac93853-2fca-4ea8-ad5d-0fcbfa9aac5a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.829406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac93853-2fca-4ea8-ad5d-0fcbfa9aac5a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.829406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac93853-2fca-4ea8-ad5d-0fcbfa9aac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.830809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.844833 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2890a0-b0e1-4979-ac4a-7aa58d9fc3bb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.858317 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9ac93853-2fca-4ea8-ad5d-0fcbfa9aac5a None None] MFA Rules not processed for user `5f18f260b4ce40598360e665d7ac3189`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:05.859762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9ac93853-2fca-4ea8-ad5d-0fcbfa9aac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:05.886528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:05.909876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808ca11-cddb-4e50-b7b9-c14892d48237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:05.909876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ca11-cddb-4e50-b7b9-c14892d48237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.909876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ca11-cddb-4e50-b7b9-c14892d48237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.909876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808ca11-cddb-4e50-b7b9-c14892d48237 admin admin] PATH_INFO: `/v3/projects/e46fd877e91947588ddf7e26cd465e59/users/82f3507ffb2448ee86436e95b803dbd6/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.916389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808ca11-cddb-4e50-b7b9-c14892d48237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46fd877e91947588ddf7e26cd465e59, user_id=82f3507ffb2448ee86436e95b803dbd6, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:05.919842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808ca11-cddb-4e50-b7b9-c14892d48237 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:05.941893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1305/2585] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:05 2022] PUT /identity/v3/projects/e46fd877e91947588ddf7e26cd465e59/users/82f3507ffb2448ee86436e95b803dbd6/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:05.948141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1281/2586] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:05.952418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:05.952680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac93853-2fca-4ea8-ad5d-0fcbfa9aac5a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:05.952797 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:05.952971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:05.966510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac93853-2fca-4ea8-ad5d-0fcbfa9aac5a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:05.984652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] MFA Rules not processed for user `82f3507ffb2448ee86436e95b803dbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:05.985921 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:06.054067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.054929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.055216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.055498 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.056309 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.058152 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.087068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1306/2587] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:06.101124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.102533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:06.151717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1282/2588] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:05 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:06.155599 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.188028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:06.191627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b416-ae7c-4d0e-81c8-f3804cc21e25 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.228693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475912f-03e8-45e6-a18b-804e9399bf12 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.233891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.234570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.234952 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.235277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.235979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.238019 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.251358 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.255466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.255466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.255466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.289700 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:06.322038 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1283/2589] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:06 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:06.323789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.330435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.336090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.338311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a08b4-1902-4c71-aa61-8bbb3ce9d11c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.343615 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.344726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1307/2590] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:06.345070 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.345471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.345821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.346635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.348468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.362875 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1284/2591] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:06.367528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.396668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ee94e-93a5-4f37-8a16-34911c8ff2e6 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.404879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.406126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.407430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.408213 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] PATH_INFO: `/v3/projects/f5b78385274c4600949b5a436d3ce4d3/users/5ba9e6fb2b0d4820ae1c1a2104e5b581/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.432211 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b78385274c4600949b5a436d3ce4d3, user_id=5ba9e6fb2b0d4820ae1c1a2104e5b581, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.437514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.520108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1308/2592] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:06 2022] PUT /identity/v3/projects/f5b78385274c4600949b5a436d3ce4d3/users/5ba9e6fb2b0d4820ae1c1a2104e5b581/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:06.523742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.533664 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2f577-d40c-458b-aa5c-0ab5005092a1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.610618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7bb0f-b47c-4f9a-b3d1-b62ace72063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.611451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7bb0f-b47c-4f9a-b3d1-b62ace72063f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.611815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7bb0f-b47c-4f9a-b3d1-b62ace72063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.612161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7bb0f-b47c-4f9a-b3d1-b62ace72063f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.612900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7bb0f-b47c-4f9a-b3d1-b62ace72063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.614606 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7bb0f-b47c-4f9a-b3d1-b62ace72063f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.628288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1285/2593] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:06.629814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.640327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62115-178b-467b-89ee-c83a4e866f9b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.645033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.646535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.646875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.647156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] PATH_INFO: `/v3/projects/f5b78385274c4600949b5a436d3ce4d3/users/5ba9e6fb2b0d4820ae1c1a2104e5b581/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.649334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b78385274c4600949b5a436d3ce4d3, user_id=5ba9e6fb2b0d4820ae1c1a2104e5b581, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.652012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.662588 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1309/2594] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:06 2022] PUT /identity/v3/projects/f5b78385274c4600949b5a436d3ce4d3/users/5ba9e6fb2b0d4820ae1c1a2104e5b581/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:06.672975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44427b24-1a55-429a-9eef-1e83ee4eb817 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.673267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44427b24-1a55-429a-9eef-1e83ee4eb817 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.673551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44427b24-1a55-429a-9eef-1e83ee4eb817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.700159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-44427b24-1a55-429a-9eef-1e83ee4eb817 None None] MFA Rules not processed for user `5ba9e6fb2b0d4820ae1c1a2104e5b581`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:06.701496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-44427b24-1a55-429a-9eef-1e83ee4eb817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:06.778361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1286/2595] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:06.789313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.847905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dae71-1c7d-4bf3-8a1f-d694fc08de94 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.852425 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.853078 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.853390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.853668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.863086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:06.864563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:06.874307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1310/2596] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:06.938526 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44427b24-1a55-429a-9eef-1e83ee4eb817 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:06.950557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44427b24-1a55-429a-9eef-1e83ee4eb817 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:06.954318 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:06.955005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:06.955294 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:06.955586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:06.980773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:07.018304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:07.019857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:07.034781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1287/2597] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:07.538297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:07.640276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8120-e80e-457d-8879-886eee51f844 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:07.648210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f3507ffb2448ee86436e95b803dbd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e46fd877e91947588ddf7e26cd465e59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:07.649066 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:07.649433 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:07.649800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:07.650837 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:07.651273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:07.654146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:07.676714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1311/2598] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:42:07.683846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:07.702555 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670025f2-c366-4249-9df6-1d4c691f88df service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:07.718432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f3507ffb2448ee86436e95b803dbd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e46fd877e91947588ddf7e26cd465e59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:07.719148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:07.719442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:07.719740 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:07.720436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:07.722416 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:07.848475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1288/2599] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:07 2022] POST /identity/v3/projects => generated 354 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:07.850578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:07.861226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa425c-e59d-45e7-a230-c1fc8d5f6695 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:07.884979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:07.934576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f3507ffb2448ee86436e95b803dbd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e46fd877e91947588ddf7e26cd465e59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:07.935374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:07.935746 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:07.936100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:07.936920 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:07.937524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:07.939888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:07.954064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1312/2600] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:07.991793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:08.002473 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b9d94-0bc5-4cc6-8f68-225abf3a3e35 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:08.009589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f3507ffb2448ee86436e95b803dbd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e46fd877e91947588ddf7e26cd465e59', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:08.010501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:08.010829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:08.011115 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] PATH_INFO: `/v3/projects/19b4211e7512453c911a05ecca6a3aac` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:08.012334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19b4211e7512453c911a05ecca6a3aac)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:08.015903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:08.112945 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b4211e7512453c911a05ecca6a3aac', 'request_id': 'req-921140f9-99aa-4670-8a4a-62b439e9e91d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.120918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b4211e7512453c911a05ecca6a3aac', 'request_id': 'req-921140f9-99aa-4670-8a4a-62b439e9e91d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.123552 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:08.125402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:08.128998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b4211e7512453c911a05ecca6a3aac', 'request_id': 'req-921140f9-99aa-4670-8a4a-62b439e9e91d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.195185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8271-13fa-4035-80bb-7b8632ca1305 tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:08.207672 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] The token cache is being invalidate because project 19b4211e7512453c911a05ecca6a3aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:08.207976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.209654 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.211281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1289/2601] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:07 2022] DELETE /identity/v3/projects/19b4211e7512453c911a05ecca6a3aac => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:08.252773 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:08.253647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:08.253925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:08.254206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] PATH_INFO: `/v3/users/a71a9f43fc024c188e6b5285b9d81c4c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:08.256030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71a9f43fc024c188e6b5285b9d81c4c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:08.258149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:08.469437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71a9f43fc024c188e6b5285b9d81c4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.483438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71a9f43fc024c188e6b5285b9d81c4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.486015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:08.615508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71a9f43fc024c188e6b5285b9d81c4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.616155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71a9f43fc024c188e6b5285b9d81c4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.616812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71a9f43fc024c188e6b5285b9d81c4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:08.629627 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1313/2602] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:08 2022] DELETE /identity/v3/users/a71a9f43fc024c188e6b5285b9d81c4c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:08.914275 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:08.915850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:08.931101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921140f9-99aa-4670-8a4a-62b439e9e91d tempest-VolumeQuotaClassesTest-221543697 tempest-VolumeQuotaClassesTest-221543697-project-admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:08.968758 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:08.970354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:08.999047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.000074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.000768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.001464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] PATH_INFO: `/v3/projects/cb776c4e377848b2bbce72151c663ad2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.003452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb776c4e377848b2bbce72151c663ad2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.006091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.046137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eaa83-2bbd-4cd1-9600-c67ce2fb19bc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.050982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.056319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.056319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.056319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] PATH_INFO: `/v3/users/b5a37a82bf9f4f1f86a09f005aae6063` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.056319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a37a82bf9f4f1f86a09f005aae6063)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.056319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.108168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:09.124731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb776c4e377848b2bbce72151c663ad2', 'request_id': 'req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.130102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb776c4e377848b2bbce72151c663ad2', 'request_id': 'req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.137184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb776c4e377848b2bbce72151c663ad2', 'request_id': 'req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.203629 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] The token cache is being invalidate because project cb776c4e377848b2bbce72151c663ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:09.203924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.204551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6a81e5e1-c77a-4df0-88de-b61cbdf603b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.206093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1290/2603] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:08 2022] DELETE /identity/v3/projects/cb776c4e377848b2bbce72151c663ad2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:09.211586 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736313-2ade-4892-93ae-95ea1a4b3673 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.212007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736313-2ade-4892-93ae-95ea1a4b3673 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.212290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e736313-2ade-4892-93ae-95ea1a4b3673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.231022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2e736313-2ade-4892-93ae-95ea1a4b3673 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:09.232232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2e736313-2ade-4892-93ae-95ea1a4b3673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:09.291104 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1291/2604] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:09.291688 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a37a82bf9f4f1f86a09f005aae6063'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.299605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a935e-cbdc-42dc-ba8f-f8f3a3589640 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.300276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a935e-cbdc-42dc-ba8f-f8f3a3589640 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.300562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a935e-cbdc-42dc-ba8f-f8f3a3589640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.305179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a37a82bf9f4f1f86a09f005aae6063'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.319155 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e40a935e-cbdc-42dc-ba8f-f8f3a3589640 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:09.320358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e40a935e-cbdc-42dc-ba8f-f8f3a3589640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:09.328352 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1292/2605] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:09.332360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a935e-cbdc-42dc-ba8f-f8f3a3589640 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:09.341833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a935e-cbdc-42dc-ba8f-f8f3a3589640 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.346459 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.347135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.347417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.347694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.348409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:09.348718 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.351147 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.362544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1293/2606] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:42:09.366574 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:09.375836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207dc7-61eb-49e1-9570-9b4975aa6941 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.380821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.381449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.381736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.382042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.382748 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.384696 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.392037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a37a82bf9f4f1f86a09f005aae6063'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.392644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a37a82bf9f4f1f86a09f005aae6063'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.394135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6d16fffb-8f58-48bc-86ae-c9030d1499b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a37a82bf9f4f1f86a09f005aae6063'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:09.410908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1314/2607] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:08 2022] DELETE /identity/v3/users/b5a37a82bf9f4f1f86a09f005aae6063 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:09.416238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.416524 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.416806 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.435480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:09.436685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:09.477195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1294/2608] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:09 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:09.478186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:09.479934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:09.517943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1315/2609] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:09.525497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:09.526929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:09.533450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:09.557515 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998746c5-df9c-4a4e-81f3-32c344a4daad admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.562656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.565693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.565693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.565693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.565693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.566531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.596825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37415-7f4c-4bc9-8042-064fb3e6db34 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.646541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.647227 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.647611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.647869 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.657217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.658668 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.668491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1316/2610] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:09.702371 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1295/2611] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:09 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:09.712308 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:09.722470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3a7f-bac0-4ce5-ba20-b745e0527d83 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.730304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.732106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.732106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.732106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.732565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.734559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.751057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1317/2612] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:09.752301 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:09.764527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11330504-4c81-4349-9a81-3f46c618ce0b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.769731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31d860-e9c1-46eb-88aa-3e507dbce2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.770392 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31d860-e9c1-46eb-88aa-3e507dbce2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.771329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31d860-e9c1-46eb-88aa-3e507dbce2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.772380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31d860-e9c1-46eb-88aa-3e507dbce2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.773122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31d860-e9c1-46eb-88aa-3e507dbce2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.774749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31d860-e9c1-46eb-88aa-3e507dbce2e0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.785614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1296/2613] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:09.792464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:09.803690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ffc8b-4e2b-41e1-9ad2-cb85e29247a3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:09.808402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:09.809284 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.809565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.809837 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] PATH_INFO: `/v3/projects/73b8ee5fd3c24bd29738474cd6596753/users/2290a646313f4d0c97a7be3563df81e9/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.825252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b8ee5fd3c24bd29738474cd6596753, user_id=2290a646313f4d0c97a7be3563df81e9, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:09.827939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:09.901435 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:09.906947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1318/2614] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:09 2022] PUT /identity/v3/projects/73b8ee5fd3c24bd29738474cd6596753/users/2290a646313f4d0c97a7be3563df81e9/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:09.917847 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:09.918285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:09.918417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:09.948722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] MFA Rules not processed for user `2290a646313f4d0c97a7be3563df81e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:09.950015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:10.019825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1297/2615] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:10.034157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:10.036657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:10.095589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7fe2-56eb-4599-a2ab-4e00c10d8b49 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:10.099220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:10.100029 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:10.100317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:10.100597 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:10.109125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:10.110622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:10.120041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1319/2616] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:10.152624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:10.152624 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:10.232658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010725e1-f8ac-4cc1-b808-ec9a0d7df639 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:10.238963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:10.240844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:10.241263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:10.241513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] PATH_INFO: `/v3/projects/90855c2b077b4e0289833ee059c0a3df` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:10.242825 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90855c2b077b4e0289833ee059c0a3df)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:10.244897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:10.329533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90855c2b077b4e0289833ee059c0a3df', 'request_id': 'req-4c787911-cc4d-4e8a-a77c-823e89785b33'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.335358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90855c2b077b4e0289833ee059c0a3df', 'request_id': 'req-4c787911-cc4d-4e8a-a77c-823e89785b33'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.341412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90855c2b077b4e0289833ee059c0a3df', 'request_id': 'req-4c787911-cc4d-4e8a-a77c-823e89785b33'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.409886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] The token cache is being invalidate because project 90855c2b077b4e0289833ee059c0a3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:10.410280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.411027 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.413686 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1298/2617] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:10 2022] DELETE /identity/v3/projects/90855c2b077b4e0289833ee059c0a3df => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:10.418011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:10.429465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363cd0-d39d-4739-9142-459e078cc9b0 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:10.461995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:10.489912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:10.490903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:10.491195 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:10.491478 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] PATH_INFO: `/v3/users/82f3507ffb2448ee86436e95b803dbd6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:10.492696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f3507ffb2448ee86436e95b803dbd6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:10.494714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:10.707880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f3507ffb2448ee86436e95b803dbd6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.721462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f3507ffb2448ee86436e95b803dbd6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.827526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f3507ffb2448ee86436e95b803dbd6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.828221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f3507ffb2448ee86436e95b803dbd6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.828916 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4338770e-89fd-4aff-b782-0e498e201761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f3507ffb2448ee86436e95b803dbd6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:10.841941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1320/2618] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:10 2022] DELETE /identity/v3/users/82f3507ffb2448ee86436e95b803dbd6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:11.256896 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:11.258626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:11.275417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787911-cc4d-4e8a-a77c-823e89785b33 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:11.284153 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:11.336105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:11.336972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:11.337254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:11.337528 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] PATH_INFO: `/v3/projects/e46fd877e91947588ddf7e26cd465e59` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:11.338758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46fd877e91947588ddf7e26cd465e59)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:11.340655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:11.466886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46fd877e91947588ddf7e26cd465e59', 'request_id': 'req-05c31053-90c2-4270-80cb-e106b34c1293'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:11.472517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46fd877e91947588ddf7e26cd465e59', 'request_id': 'req-05c31053-90c2-4270-80cb-e106b34c1293'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:11.478854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46fd877e91947588ddf7e26cd465e59', 'request_id': 'req-05c31053-90c2-4270-80cb-e106b34c1293'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:11.558365 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] The token cache is being invalidate because project e46fd877e91947588ddf7e26cd465e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:11.558846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:11.559313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-05c31053-90c2-4270-80cb-e106b34c1293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:11.560814 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1299/2619] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:11 2022] DELETE /identity/v3/projects/e46fd877e91947588ddf7e26cd465e59 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:11.565778 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a90-37ad-4d56-a459-5918b256e239 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:11.566269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a90-37ad-4d56-a459-5918b256e239 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:11.566388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19a90-37ad-4d56-a459-5918b256e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:11.586157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3ba19a90-37ad-4d56-a459-5918b256e239 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:11.591582 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3ba19a90-37ad-4d56-a459-5918b256e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:11.647354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1321/2620] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:11.710007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9eea-94e6-4bc9-8a7d-a7fc0e5e3900 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:11.710320 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9eea-94e6-4bc9-8a7d-a7fc0e5e3900 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:11.710584 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9eea-94e6-4bc9-8a7d-a7fc0e5e3900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:11.730008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b03f9eea-94e6-4bc9-8a7d-a7fc0e5e3900 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:11.731358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b03f9eea-94e6-4bc9-8a7d-a7fc0e5e3900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:11.740692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1300/2621] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:11.744547 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba19a90-37ad-4d56-a459-5918b256e239 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:11.758884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba19a90-37ad-4d56-a459-5918b256e239 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:11.769353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:11.769353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:11.769353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:11.769353 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:11.770313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:11.770313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:11.770313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:11.783258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1322/2622] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:11.784354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f9eea-94e6-4bc9-8a7d-a7fc0e5e3900 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:11.795072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f9eea-94e6-4bc9-8a7d-a7fc0e5e3900 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:11.800444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:11.801105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:11.810863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:11.810863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:11.810863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:11.810863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:11.902113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1301/2623] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:11 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:11.906830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:11.916729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:11.921120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:11.921235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fffc40-3265-40d6-82ea-21ac58e39e7d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:11.955382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:11.978970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:11.979749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:11.980033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:11.980310 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:11.980983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:11.982914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:11.987186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66819b32-ecaa-4118-b71e-c01b29a76382 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:11.992633 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:11.993513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:11.993798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:11.994101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] PATH_INFO: `/v3/users/5f18f260b4ce40598360e665d7ac3189` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:11.995303 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f18f260b4ce40598360e665d7ac3189)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:11.997222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.011495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:12.101286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1323/2624] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:11 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:12.106045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.115896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dedf-a122-4c0a-a03d-27406b7f0f3b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.120543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.121191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.121480 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.121765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.122499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.124144 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.135498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1324/2625] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:12.141636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.152440 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d313b-a0ce-423c-b2ff-e8d398813a9b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.157077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.157895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.158056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.158265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.159074 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.160622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.171723 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1325/2626] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:12.175696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.185247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e32e37-7a08-412e-b290-d21414fb81e5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.189749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24171c-e508-4a90-bcda-4c8ab257fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.190587 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24171c-e508-4a90-bcda-4c8ab257fb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.190905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24171c-e508-4a90-bcda-4c8ab257fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.191183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24171c-e508-4a90-bcda-4c8ab257fb3b admin admin] PATH_INFO: `/v3/projects/be7d49dd43e14fa3bc007d880ec1d0f4/users/2b4493d2d9ad48b4b74ae00354cde45c/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.205379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24171c-e508-4a90-bcda-4c8ab257fb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7d49dd43e14fa3bc007d880ec1d0f4, user_id=2b4493d2d9ad48b4b74ae00354cde45c, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.208033 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24171c-e508-4a90-bcda-4c8ab257fb3b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.250914 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f18f260b4ce40598360e665d7ac3189'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:12.262495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f18f260b4ce40598360e665d7ac3189'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:12.263247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f18f260b4ce40598360e665d7ac3189'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:12.295886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1326/2627] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:12 2022] PUT /identity/v3/projects/be7d49dd43e14fa3bc007d880ec1d0f4/users/2b4493d2d9ad48b4b74ae00354cde45c/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:12.305890 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.306178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.306455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.338484 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] MFA Rules not processed for user `2b4493d2d9ad48b4b74ae00354cde45c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:12.339760 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:12.387007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f18f260b4ce40598360e665d7ac3189'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:12.387007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-870e980b-5f08-47a7-a5f9-58d93ad98c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f18f260b4ce40598360e665d7ac3189'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:12.389645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1302/2628] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:11 2022] DELETE /identity/v3/users/5f18f260b4ce40598360e665d7ac3189 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:12.394062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.394408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.394789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.414573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:12.416403 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:12.423764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1327/2629] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:12.428585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.430039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:12.487108 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1303/2630] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:12.499073 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.500463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:12.510767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b4b58-f3a9-418a-869a-12000156b55d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.516508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.517181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.517464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.517742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.518477 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.520497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.535443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:12.561351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7119603-7044-4b65-bf8d-cc956f0d6f7c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.565076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.565715 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.565995 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.566270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.576072 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.577504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.587400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1304/2631] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:12.719252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1328/2632] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:12 2022] POST /identity/v3/projects => generated 399 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:12.723485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.733968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439ddde-0c38-42ed-a8bd-cf66316c7d08 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.769211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:12.795569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.796262 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.796591 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.796912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.797617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.799571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.886570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1305/2633] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:12 2022] POST /identity/v3/users => generated 306 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:12.887819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.899020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65b0f-cc04-474e-9326-44268a240f58 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.904107 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.904814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.905120 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.905398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.906129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.907784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.920986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1329/2634] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:12.925282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:12.936166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a244fd-a6c1-422c-9d42-bd8e33349b6a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:12.940620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:12.941511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:12.941790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:12.942064 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] PATH_INFO: `/v3/projects/5a9425592dac405f9b41bdc46b28dc5d/users/132b611fac1b457c9d9bf761d9b8e01a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:12.957430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9425592dac405f9b41bdc46b28dc5d, user_id=132b611fac1b457c9d9bf761d9b8e01a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:12.961295 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:12.999892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:13.001770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:13.015757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7475fb-49bb-43ad-b19b-8f59cd0328ee admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:13.020764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:13.022188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:13.022543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:13.022955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] PATH_INFO: `/v3/projects/20088af291444ccea67778274f6e31f0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:13.024101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=20088af291444ccea67778274f6e31f0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:13.026280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:13.048688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1306/2635] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:12 2022] PUT /identity/v3/projects/5a9425592dac405f9b41bdc46b28dc5d/users/132b611fac1b457c9d9bf761d9b8e01a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:13.053283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:13.115407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb704ad-3f1a-4566-bde7-7a7cb2f7329c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:13.120137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:13.120832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:13.121125 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:13.121415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:13.122141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:13.123790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:13.133957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1307/2636] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:13.138010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:13.148263 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511cef5-f3fb-4ace-9c0d-293e328d7a2c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:13.149624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20088af291444ccea67778274f6e31f0', 'request_id': 'req-34389532-5ab2-41f8-928f-858a7bb7c5db'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.205999 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1357-3b5d-4506-a2a2-79691390c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:13.206841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1357-3b5d-4506-a2a2-79691390c459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:13.207124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1357-3b5d-4506-a2a2-79691390c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:13.207400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1357-3b5d-4506-a2a2-79691390c459 admin admin] PATH_INFO: `/v3/projects/5a9425592dac405f9b41bdc46b28dc5d/users/132b611fac1b457c9d9bf761d9b8e01a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:13.210491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1357-3b5d-4506-a2a2-79691390c459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9425592dac405f9b41bdc46b28dc5d, user_id=132b611fac1b457c9d9bf761d9b8e01a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:13.213157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1357-3b5d-4506-a2a2-79691390c459 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:13.224285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1308/2637] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:13 2022] PUT /identity/v3/projects/5a9425592dac405f9b41bdc46b28dc5d/users/132b611fac1b457c9d9bf761d9b8e01a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:13.234246 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:13.234535 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:13.234841 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:13.243092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20088af291444ccea67778274f6e31f0', 'request_id': 'req-34389532-5ab2-41f8-928f-858a7bb7c5db'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.249637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20088af291444ccea67778274f6e31f0', 'request_id': 'req-34389532-5ab2-41f8-928f-858a7bb7c5db'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.261999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] The token cache is being invalidate because project 20088af291444ccea67778274f6e31f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:13.262256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] MFA Rules not processed for user `132b611fac1b457c9d9bf761d9b8e01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:13.262730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.263402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.263540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:13.265037 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1330/2638] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:12 2022] DELETE /identity/v3/projects/20088af291444ccea67778274f6e31f0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:13.269026 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:13.270525 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:13.284238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34389532-5ab2-41f8-928f-858a7bb7c5db admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:13.285043 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:13.338678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1309/2639] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:13.350568 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:13.350745 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:13.351566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:13.351876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:13.352003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:13.352204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] PATH_INFO: `/v3/users/5ba9e6fb2b0d4820ae1c1a2104e5b581` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:13.353468 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba9e6fb2b0d4820ae1c1a2104e5b581)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:13.355491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:13.410437 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94083da-2186-4658-991d-1ec24dbd3171 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:13.414337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:13.415036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:13.415326 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:13.416802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:13.425378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:13.426848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:13.442099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1310/2640] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:13.699529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba9e6fb2b0d4820ae1c1a2104e5b581'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.708368 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:13.712940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba9e6fb2b0d4820ae1c1a2104e5b581'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.717271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:13.718188 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec7eb-961f-4187-bfaa-74187dcece02 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:13.722420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:13.722727 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:13.723016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:13.723308 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:13.725918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:13.789921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:13.791406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:13.800455 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1311/2641] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:13.828275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba9e6fb2b0d4820ae1c1a2104e5b581'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.829502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba9e6fb2b0d4820ae1c1a2104e5b581'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.830250 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d0e609b1-2113-4585-b496-491316410fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba9e6fb2b0d4820ae1c1a2104e5b581'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:13.843248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1331/2642] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:13 2022] DELETE /identity/v3/users/5ba9e6fb2b0d4820ae1c1a2104e5b581 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:14.296697 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:14.308839 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756434e-0ef2-451d-be2b-1c33c0761d47 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:14.360741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:14.367467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:14.368363 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:14.368670 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:14.368951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] PATH_INFO: `/v3/projects/f5b78385274c4600949b5a436d3ce4d3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:14.370169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b78385274c4600949b5a436d3ce4d3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:14.372106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:14.548802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b78385274c4600949b5a436d3ce4d3', 'request_id': 'req-27b27d86-45b4-4e04-9ca9-b374181f0f12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:14.554948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b78385274c4600949b5a436d3ce4d3', 'request_id': 'req-27b27d86-45b4-4e04-9ca9-b374181f0f12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:14.561219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b78385274c4600949b5a436d3ce4d3', 'request_id': 'req-27b27d86-45b4-4e04-9ca9-b374181f0f12'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:14.642901 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] The token cache is being invalidate because project f5b78385274c4600949b5a436d3ce4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:14.643189 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:14.643833 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-27b27d86-45b4-4e04-9ca9-b374181f0f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:14.645420 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1312/2643] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:14 2022] DELETE /identity/v3/projects/f5b78385274c4600949b5a436d3ce4d3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:14.651210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40803182-e7b5-4fe8-98e1-b402e452eb53 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:14.651505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40803182-e7b5-4fe8-98e1-b402e452eb53 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:14.651816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40803182-e7b5-4fe8-98e1-b402e452eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:14.670777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-40803182-e7b5-4fe8-98e1-b402e452eb53 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:14.672312 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-40803182-e7b5-4fe8-98e1-b402e452eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:14.731512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1332/2644] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:14.739993 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96614b7-5bd7-4c72-abd0-db2b2681ccc1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:14.740284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96614b7-5bd7-4c72-abd0-db2b2681ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:14.740567 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96614b7-5bd7-4c72-abd0-db2b2681ccc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:14.759219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d96614b7-5bd7-4c72-abd0-db2b2681ccc1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:14.760430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d96614b7-5bd7-4c72-abd0-db2b2681ccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:14.768644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1313/2645] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:14.773497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40803182-e7b5-4fe8-98e1-b402e452eb53 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:14.783622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40803182-e7b5-4fe8-98e1-b402e452eb53 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:14.790504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:14.791203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:14.791485 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:14.791757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:14.792486 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:14.793045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:14.794711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:14.807197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1333/2646] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:14.811661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96614b7-5bd7-4c72-abd0-db2b2681ccc1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:14.821538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96614b7-5bd7-4c72-abd0-db2b2681ccc1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:14.826509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:14.827351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:14.827652 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:14.827934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:14.828635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:14.830548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:14.924713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1314/2647] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:14 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:14.928959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:14.939053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474331-6945-4c31-b394-0a61b6790159 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:14.996839 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:14.997512 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:14.997800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:14.998100 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:14.998842 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.000757 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.100713 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1334/2648] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:14 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:15.104910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.116292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4103b06-ee0f-4982-ba18-dc35f7cbb110 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:15.121518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:15.121924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.122218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.122500 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.123268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.124909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.136255 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1315/2649] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:15.140130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.150431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713e42-b733-456f-a000-39a26dfb509d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:15.155210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b7fa4-e52e-4ebe-95fb-b1bb13c04850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:15.155894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b7fa4-e52e-4ebe-95fb-b1bb13c04850 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.156179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b7fa4-e52e-4ebe-95fb-b1bb13c04850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.156459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b7fa4-e52e-4ebe-95fb-b1bb13c04850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.157202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b7fa4-e52e-4ebe-95fb-b1bb13c04850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.158861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b7fa4-e52e-4ebe-95fb-b1bb13c04850 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.169265 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1335/2650] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:15.173334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.184062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e106af-86f6-43e3-bf59-3c132ba5a465 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:15.188753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:15.189649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.189938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.190220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] PATH_INFO: `/v3/projects/b59179a2c8c642168fbd0e215ca6d178/users/63d487b485564500a10db24d57662b44/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.205507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59179a2c8c642168fbd0e215ca6d178, user_id=63d487b485564500a10db24d57662b44, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.208273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.316915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1316/2651] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:15 2022] PUT /identity/v3/projects/b59179a2c8c642168fbd0e215ca6d178/users/63d487b485564500a10db24d57662b44/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:15.328783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa305bf-7606-41e1-933c-f5c1817ab697 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.329073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa305bf-7606-41e1-933c-f5c1817ab697 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.329350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa305bf-7606-41e1-933c-f5c1817ab697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.356396 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-eaa305bf-7606-41e1-933c-f5c1817ab697 None None] MFA Rules not processed for user `63d487b485564500a10db24d57662b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:15.357613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eaa305bf-7606-41e1-933c-f5c1817ab697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:15.399568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:15.422622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1336/2652] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:15.427919 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.492408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e2570-bc81-441e-82c9-e45c6ea6813f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:15.500597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:15.500597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.500597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.500888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.501543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.503499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.590929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1317/2653] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:15 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:15.592075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa305bf-7606-41e1-933c-f5c1817ab697 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.603445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa305bf-7606-41e1-933c-f5c1817ab697 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:15.658792 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:15.659462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.659748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.660027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.660712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.663191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.762702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1337/2654] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:15 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:15.766729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.778086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158308b-b1a0-4a09-80ea-5684308d025b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:15.782873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:15.783531 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.783819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.784101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.784831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.786447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.789140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:15.798361 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1318/2655] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:15.803166 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.813086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c1e-ced4-4fa0-8779-159e04bf0152 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:15.817883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:15.818825 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:15.819115 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:15.819489 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] PATH_INFO: `/v3/projects/7402ac590795448193276b1089e66b57/users/5cf230a170124863b74a8e3975f426c3/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:15.837000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7402ac590795448193276b1089e66b57, user_id=5cf230a170124863b74a8e3975f426c3, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:15.839843 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:15.929385 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1338/2656] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:15 2022] PUT /identity/v3/projects/7402ac590795448193276b1089e66b57/users/5cf230a170124863b74a8e3975f426c3/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:15.933480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:15.944330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa6e5-5d9a-483e-b11b-7c3c3b84317e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:16.000775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd3c54-2f43-4025-8cee-8fd8496c6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:16.001442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3c54-2f43-4025-8cee-8fd8496c6e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:16.001728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3c54-2f43-4025-8cee-8fd8496c6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:16.002014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3c54-2f43-4025-8cee-8fd8496c6e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:16.002767 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd3c54-2f43-4025-8cee-8fd8496c6e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:16.004370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd3c54-2f43-4025-8cee-8fd8496c6e30 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:16.014093 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1319/2657] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:16.018206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:16.029595 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd05d75-7dc0-44ae-8492-8be6e9e65af1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:16.034243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:16.035154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:16.035432 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:16.035701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] PATH_INFO: `/v3/projects/7402ac590795448193276b1089e66b57/users/5cf230a170124863b74a8e3975f426c3/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:16.038907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7402ac590795448193276b1089e66b57, user_id=5cf230a170124863b74a8e3975f426c3, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:16.041473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:16.052015 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1339/2658] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:16 2022] PUT /identity/v3/projects/7402ac590795448193276b1089e66b57/users/5cf230a170124863b74a8e3975f426c3/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:16.062512 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8d2d-b98b-4fee-b380-5a272fb8c4b0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:16.062848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8d2d-b98b-4fee-b380-5a272fb8c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:16.063136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8d2d-b98b-4fee-b380-5a272fb8c4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:16.090141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a8fa8d2d-b98b-4fee-b380-5a272fb8c4b0 None None] MFA Rules not processed for user `5cf230a170124863b74a8e3975f426c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:16.091321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a8fa8d2d-b98b-4fee-b380-5a272fb8c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:16.176726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1320/2659] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:16.185248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:16.187168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:16.252897 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5cad3-6d1d-45d1-aba8-9a5979f15efe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:16.257628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:16.258274 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:16.258560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:16.258882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:16.268192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:16.269616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:16.280400 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1340/2660] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:16.385966 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa8d2d-b98b-4fee-b380-5a272fb8c4b0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:16.396236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa8d2d-b98b-4fee-b380-5a272fb8c4b0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:16.400523 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c2881-fc28-4cf9-a255-4fc328445fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:16.401854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c2881-fc28-4cf9-a255-4fc328445fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:16.401854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c2881-fc28-4cf9-a255-4fc328445fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:16.401854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c2881-fc28-4cf9-a255-4fc328445fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:16.464281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c2881-fc28-4cf9-a255-4fc328445fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:16.465742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c2881-fc28-4cf9-a255-4fc328445fc1 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:16.474956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1321/2661] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:18.984098 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:18.985636 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:19.028652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:19.052108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d1ca-0b40-43fb-a076-9adca7920c8c service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:19.056849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:19.057717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:19.058004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:19.058285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] PATH_INFO: `/v3/users/2b4493d2d9ad48b4b74ae00354cde45c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:19.059521 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4493d2d9ad48b4b74ae00354cde45c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:19.061473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:19.211344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4493d2d9ad48b4b74ae00354cde45c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:19.223256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4493d2d9ad48b4b74ae00354cde45c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:19.288816 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4493d2d9ad48b4b74ae00354cde45c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:19.289438 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4493d2d9ad48b4b74ae00354cde45c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:19.290051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4493d2d9ad48b4b74ae00354cde45c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:19.303273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1341/2662] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:18 2022] DELETE /identity/v3/users/2b4493d2d9ad48b4b74ae00354cde45c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:19.307870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:19.308373 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:19.308483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:19.325779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:19.327016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:19.339545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:19.386659 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1322/2663] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:19.397276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:19.398759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:19.455473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54ca7-0ddc-4bc3-aa07-9b797a68fced admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:19.459356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:19.460035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:19.460317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:19.460592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:19.472182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:19.473684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:19.484559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1342/2664] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:19.885992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:19.889132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:19.899644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538b157-1720-4fd9-b072-b7ecb944f2a7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:19.904378 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:19.905256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:19.905543 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:19.905894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] PATH_INFO: `/v3/projects/be7d49dd43e14fa3bc007d880ec1d0f4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:19.907046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7d49dd43e14fa3bc007d880ec1d0f4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:19.908955 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:20.022059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7d49dd43e14fa3bc007d880ec1d0f4', 'request_id': 'req-0f7623ce-5596-4e10-b15b-61fb6f673830'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.027954 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7d49dd43e14fa3bc007d880ec1d0f4', 'request_id': 'req-0f7623ce-5596-4e10-b15b-61fb6f673830'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.034254 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7d49dd43e14fa3bc007d880ec1d0f4', 'request_id': 'req-0f7623ce-5596-4e10-b15b-61fb6f673830'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.122854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] The token cache is being invalidate because project be7d49dd43e14fa3bc007d880ec1d0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:20.123146 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.123766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.125377 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1323/2665] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:19 2022] DELETE /identity/v3/projects/be7d49dd43e14fa3bc007d880ec1d0f4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:20.129451 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:20.139625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0c98-a85f-4666-97c7-e74446ac23fb service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:20.196683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:20.197589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:20.197870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:20.198142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] PATH_INFO: `/v3/users/132b611fac1b457c9d9bf761d9b8e01a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:20.199341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132b611fac1b457c9d9bf761d9b8e01a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:20.201252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:20.202822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:20.411189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132b611fac1b457c9d9bf761d9b8e01a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.424846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132b611fac1b457c9d9bf761d9b8e01a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.500364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132b611fac1b457c9d9bf761d9b8e01a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.501020 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132b611fac1b457c9d9bf761d9b8e01a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.501639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132b611fac1b457c9d9bf761d9b8e01a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:20.515612 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1343/2666] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:20 2022] DELETE /identity/v3/users/132b611fac1b457c9d9bf761d9b8e01a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:20.824234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:20.825850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:20.840017 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7623ce-5596-4e10-b15b-61fb6f673830 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:20.878473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:20.879999 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:20.902270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:20.903219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:20.903507 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:20.903784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] PATH_INFO: `/v3/users/63d487b485564500a10db24d57662b44` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:20.905015 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d487b485564500a10db24d57662b44)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:20.906977 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:20.955621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990056-8ef6-4ab9-b963-925f8f496a68 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:20.960834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:20.961702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:20.961981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:20.962257 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] PATH_INFO: `/v3/users/2290a646313f4d0c97a7be3563df81e9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:20.963495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2290a646313f4d0c97a7be3563df81e9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:20.965421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.105288 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:21.107807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d487b485564500a10db24d57662b44'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.120456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d487b485564500a10db24d57662b44'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.120935 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d487b485564500a10db24d57662b44'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.130780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2290a646313f4d0c97a7be3563df81e9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.144052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2290a646313f4d0c97a7be3563df81e9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.184968 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d487b485564500a10db24d57662b44'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.185663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d487b485564500a10db24d57662b44'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.199202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1324/2667] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:20 2022] DELETE /identity/v3/users/63d487b485564500a10db24d57662b44 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:21.199994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.201341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.232056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2290a646313f4d0c97a7be3563df81e9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.232684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2290a646313f4d0c97a7be3563df81e9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.233299 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3cd26a62-8166-49b1-addf-126f51693089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2290a646313f4d0c97a7be3563df81e9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.242483 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:21.247933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1344/2668] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:20 2022] DELETE /identity/v3/users/2290a646313f4d0c97a7be3563df81e9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:21.252131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3abc-67da-465b-9824-902d358247c2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.252428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3abc-67da-465b-9824-902d358247c2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.252711 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3abc-67da-465b-9824-902d358247c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.267148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8b27e-0923-4395-83c1-b676c4536345 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.270392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-602a3abc-67da-465b-9824-902d358247c2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:21.271661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-602a3abc-67da-465b-9824-902d358247c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.325321 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.326191 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.326479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.326799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] PATH_INFO: `/v3/projects/5a9425592dac405f9b41bdc46b28dc5d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.328067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9425592dac405f9b41bdc46b28dc5d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.329998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.331876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1345/2669] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:21.335145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.335145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.335145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.352544 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:21.353925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.361898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1346/2670] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:21.362970 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.364179 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.423180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065b8f-a20d-4c7c-981d-1bb98bbefa68 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.434181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9425592dac405f9b41bdc46b28dc5d', 'request_id': 'req-9d20a0f4-562f-4e9e-aed9-361c0a392d05'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.439784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9425592dac405f9b41bdc46b28dc5d', 'request_id': 'req-9d20a0f4-562f-4e9e-aed9-361c0a392d05'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.446259 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9425592dac405f9b41bdc46b28dc5d', 'request_id': 'req-9d20a0f4-562f-4e9e-aed9-361c0a392d05'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.473025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da45bc-af4a-445e-83d3-64c155829bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.473681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da45bc-af4a-445e-83d3-64c155829bbe service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.473968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da45bc-af4a-445e-83d3-64c155829bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.474246 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da45bc-af4a-445e-83d3-64c155829bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.524726 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:21.529561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] The token cache is being invalidate because project 5a9425592dac405f9b41bdc46b28dc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:21.529881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.530559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:21.532166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1325/2671] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:21 2022] DELETE /identity/v3/projects/5a9425592dac405f9b41bdc46b28dc5d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:21.535673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.535673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.535984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da45bc-af4a-445e-83d3-64c155829bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.537557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da45bc-af4a-445e-83d3-64c155829bbe service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.542317 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:21.547304 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20a0f4-562f-4e9e-aed9-361c0a392d05 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.548852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1347/2672] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:21.550147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccb3d-59b1-4eeb-ad4b-333b10579b7b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.550434 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccb3d-59b1-4eeb-ad4b-333b10579b7b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.550740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccb3d-59b1-4eeb-ad4b-333b10579b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.551151 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d722616-6699-456a-8157-1f4348ffb495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.551791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d722616-6699-456a-8157-1f4348ffb495 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.552082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d722616-6699-456a-8157-1f4348ffb495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.552362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d722616-6699-456a-8157-1f4348ffb495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.554918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5d722616-6699-456a-8157-1f4348ffb495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.568984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d722616-6699-456a-8157-1f4348ffb495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.569753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d722616-6699-456a-8157-1f4348ffb495 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.569877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-00fccb3d-59b1-4eeb-ad4b-333b10579b7b None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:21.571016 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-00fccb3d-59b1-4eeb-ad4b-333b10579b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.580024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1326/2673] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:21.580217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1348/2674] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:21.589502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92fbfe-7252-4621-81c5-8247f7f1432f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.589986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92fbfe-7252-4621-81c5-8247f7f1432f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.590280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92fbfe-7252-4621-81c5-8247f7f1432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.609510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1a92fbfe-7252-4621-81c5-8247f7f1432f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:21.613781 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1a92fbfe-7252-4621-81c5-8247f7f1432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:21.619862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1327/2675] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:21.624180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fccb3d-59b1-4eeb-ad4b-333b10579b7b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.634755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fccb3d-59b1-4eeb-ad4b-333b10579b7b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.639631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.640374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.640734 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.641093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.641929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:21.642315 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.643950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.656261 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1349/2676] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:21.660775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92fbfe-7252-4621-81c5-8247f7f1432f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.671156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92fbfe-7252-4621-81c5-8247f7f1432f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.676457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.677311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.678083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.679145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.679873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.681820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.765570 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1328/2677] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:21 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:21.769680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.780529 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51926a-0776-4c3c-94dc-fc9b4c9f8eef admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.843341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.844137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.844902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.844902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.845697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.847809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.933362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1350/2678] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:21 2022] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:21.934521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.946415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001faa68-dd2e-416f-afca-dc5ef486b150 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.951382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.952178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.952472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.953049 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.953470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.955118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:21.967139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1329/2679] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:21.971226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:21.982724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4eb2-0a22-4045-86e6-c058442cf1df admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:21.987407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:21.988506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:21.988798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:21.989071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:21.989861 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:21.992121 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.006183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1351/2680] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:22.008048 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.019111 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1851e7-261a-4e10-a931-bcef5a02aa0f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.024008 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.025065 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.025183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.025454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] PATH_INFO: `/v3/projects/59b70946bfe4461d94043c1eaa3816f8/users/c0f26461216a43d59c65104bf51571af/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.041349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b70946bfe4461d94043c1eaa3816f8, user_id=c0f26461216a43d59c65104bf51571af, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.044402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.084914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.086743 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.107465 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd313f-9cc3-4b3f-86ab-843e210110ac admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.107604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1330/2681] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:22 2022] PUT /identity/v3/projects/59b70946bfe4461d94043c1eaa3816f8/users/c0f26461216a43d59c65104bf51571af/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:22.110530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.112529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.180947 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.181818 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.182108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.182389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] PATH_INFO: `/v3/projects/b59179a2c8c642168fbd0e215ca6d178` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.183766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59179a2c8c642168fbd0e215ca6d178)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.185625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.186166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8f312-41c1-4f9f-a741-7bc68ca82a66 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.190804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.191663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.191950 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.192235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] PATH_INFO: `/v3/projects/73b8ee5fd3c24bd29738474cd6596753` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.193429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b8ee5fd3c24bd29738474cd6596753)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.195625 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.277659 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59179a2c8c642168fbd0e215ca6d178', 'request_id': 'req-530fd958-168f-4235-bb93-e5e1044ba389'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.334880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b8ee5fd3c24bd29738474cd6596753', 'request_id': 'req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.340362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b8ee5fd3c24bd29738474cd6596753', 'request_id': 'req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.346138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59179a2c8c642168fbd0e215ca6d178', 'request_id': 'req-530fd958-168f-4235-bb93-e5e1044ba389'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.350231 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b8ee5fd3c24bd29738474cd6596753', 'request_id': 'req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.350382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:22.353562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59179a2c8c642168fbd0e215ca6d178', 'request_id': 'req-530fd958-168f-4235-bb93-e5e1044ba389'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.364974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] The token cache is being invalidate because project b59179a2c8c642168fbd0e215ca6d178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:22.365266 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.365926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-530fd958-168f-4235-bb93-e5e1044ba389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.368580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1352/2682] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:22 2022] DELETE /identity/v3/projects/b59179a2c8c642168fbd0e215ca6d178 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:22.372866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.373155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.379092 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.398926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] MFA Rules not processed for user `c0f26461216a43d59c65104bf51571af`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:22.400138 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.464235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1353/2683] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:22.464998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.465475 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] The token cache is being invalidate because project 73b8ee5fd3c24bd29738474cd6596753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:22.465733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.466359 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.466491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.467943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1331/2684] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:22 2022] DELETE /identity/v3/projects/73b8ee5fd3c24bd29738474cd6596753 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:22.471799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.473102 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.487028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:22.541382 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e22a15-a354-4ebf-9546-f343212b881b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.542355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62292fbe-a6da-4c8b-b703-9cbfa6a2c14b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.546202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.547122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.547269 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b42bf-5de6-488c-b106-19ffb6dbcf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.547406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.547676 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] PATH_INFO: `/v3/users/5cf230a170124863b74a8e3975f426c3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.547937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b42bf-5de6-488c-b106-19ffb6dbcf87 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.548225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b42bf-5de6-488c-b106-19ffb6dbcf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.548511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b42bf-5de6-488c-b106-19ffb6dbcf87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.548871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf230a170124863b74a8e3975f426c3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.549198 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b42bf-5de6-488c-b106-19ffb6dbcf87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.550873 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.554181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b42bf-5de6-488c-b106-19ffb6dbcf87 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.668042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1332/2685] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:22 2022] POST /identity/v3/projects => generated 407 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:22.669408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd75bf-a8bc-46e2-bdce-37d1aa2ac1b4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.669702 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd75bf-a8bc-46e2-bdce-37d1aa2ac1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.669986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd75bf-a8bc-46e2-bdce-37d1aa2ac1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.686848 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4edd75bf-a8bc-46e2-bdce-37d1aa2ac1b4 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:22.688062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4edd75bf-a8bc-46e2-bdce-37d1aa2ac1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.747575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1333/2686] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:22.748366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd75bf-a8bc-46e2-bdce-37d1aa2ac1b4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.757680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd75bf-a8bc-46e2-bdce-37d1aa2ac1b4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.762310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d3cdf-dba7-4ac2-a751-152ea1910c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.762980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d3cdf-dba7-4ac2-a751-152ea1910c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.763272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d3cdf-dba7-4ac2-a751-152ea1910c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.763554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d3cdf-dba7-4ac2-a751-152ea1910c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.764241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d3cdf-dba7-4ac2-a751-152ea1910c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.766172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d3cdf-dba7-4ac2-a751-152ea1910c6a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.788053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf230a170124863b74a8e3975f426c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.800791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf230a170124863b74a8e3975f426c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.846585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1334/2687] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:22 2022] POST /identity/v3/users => generated 310 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:22.846585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.846585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.846585 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.860599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf230a170124863b74a8e3975f426c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.866563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf230a170124863b74a8e3975f426c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.866563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf230a170124863b74a8e3975f426c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:22.866863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:22.866863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.868460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:22.873687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1335/2688] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:22.874465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.875711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:22.879674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1354/2689] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:22 2022] DELETE /identity/v3/users/5cf230a170124863b74a8e3975f426c3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:22.889023 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.889333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1818656-a1c3-441d-84e1-0479a3a7eac1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.956126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.956918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.957109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.957391 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.958138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.960058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.962303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a099-b418-46ae-af13-06161e8fcd5e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.968802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.969350 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.969638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.969913 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.970731 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:22.975618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:22.975750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1336/2690] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:22.975898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:22.976001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.986589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddead6e-e138-4783-bb43-6fb35a7af9b4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:22.986791 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1355/2691] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:22.990907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:22.991940 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:22.992921 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:22.993215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:22.993493 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] PATH_INFO: `/v3/projects/05727978d9cc45fab80fe2eb19b3788b/users/fe98c2ac68a6452eaa4fa27e5d86a7c1/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:22.996948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:23.004149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c640e-c966-483c-aa39-47e35f5ab834 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.005652 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.006286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.006571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.006875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.008171 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.009886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05727978d9cc45fab80fe2eb19b3788b, user_id=fe98c2ac68a6452eaa4fa27e5d86a7c1, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.010073 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.012562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.136971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1337/2692] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:22 2022] PUT /identity/v3/projects/05727978d9cc45fab80fe2eb19b3788b/users/fe98c2ac68a6452eaa4fa27e5d86a7c1/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:23.140787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.170632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1356/2693] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:22 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:23.175650 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.225365 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf00f5-7594-4ed9-b6be-706654d1b504 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.249918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4a133-7531-48bf-876e-e93086de6e26 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.254875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.255522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.255808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.256086 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.256810 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.259533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.286894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.287598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.287883 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.288157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.289192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.290806 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.301442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1338/2694] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:23.306109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.315571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137c953-c7f4-4b87-ab3b-a67ce4ebb240 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.320811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebc35a-0b86-4c69-b2aa-db816a47254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.321657 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebc35a-0b86-4c69-b2aa-db816a47254a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.321942 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebc35a-0b86-4c69-b2aa-db816a47254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.322256 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebc35a-0b86-4c69-b2aa-db816a47254a admin admin] PATH_INFO: `/v3/projects/05727978d9cc45fab80fe2eb19b3788b/users/fe98c2ac68a6452eaa4fa27e5d86a7c1/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.324264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebc35a-0b86-4c69-b2aa-db816a47254a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05727978d9cc45fab80fe2eb19b3788b, user_id=fe98c2ac68a6452eaa4fa27e5d86a7c1, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.326880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebc35a-0b86-4c69-b2aa-db816a47254a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.336776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1339/2695] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:23 2022] PUT /identity/v3/projects/05727978d9cc45fab80fe2eb19b3788b/users/fe98c2ac68a6452eaa4fa27e5d86a7c1/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:23.348626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187899c-7f69-4461-ace5-b80eabdab86d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.348948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187899c-7f69-4461-ace5-b80eabdab86d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.349232 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187899c-7f69-4461-ace5-b80eabdab86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.367216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1357/2696] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:23 2022] POST /identity/v3/users => generated 303 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:23.370622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.372560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:23.378279 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6187899c-7f69-4461-ace5-b80eabdab86d None None] MFA Rules not processed for user `fe98c2ac68a6452eaa4fa27e5d86a7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:23.379566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6187899c-7f69-4461-ace5-b80eabdab86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:23.388848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d623713-4267-49fb-8755-5d5b88672013 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.446656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:23.452474 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:23.452887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.453891 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.454454 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.454738 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] PATH_INFO: `/v3/projects/7402ac590795448193276b1089e66b57` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.455969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7402ac590795448193276b1089e66b57)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.457471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1340/2697] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:23.458438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187899c-7f69-4461-ace5-b80eabdab86d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.459204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.470197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187899c-7f69-4461-ace5-b80eabdab86d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.475134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.475879 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.476804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.477088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.477818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.479443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.489593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1341/2698] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:23.494731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.494731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:23.551946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf47cce-c68f-4b22-8168-37516371507a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.556286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.556932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.557220 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.557502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.566340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.567903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.577982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1342/2699] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:23 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:23.578794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.588694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458ab5-ce19-413b-b12d-123c6daed651 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.594834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.597831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.597831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.597831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.597831 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.598519 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.620888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1343/2700] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:23.620888 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.623035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7402ac590795448193276b1089e66b57', 'request_id': 'req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:23.635983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb55e2-f844-413d-bbd7-02636aad6d8a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.699895 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2be5ff-65d6-4398-a444-229b47f4d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.700313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7402ac590795448193276b1089e66b57', 'request_id': 'req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:23.700789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2be5ff-65d6-4398-a444-229b47f4d7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.701075 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2be5ff-65d6-4398-a444-229b47f4d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.701353 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2be5ff-65d6-4398-a444-229b47f4d7f2 admin admin] PATH_INFO: `/v3/projects/45a70e97cd9043b599851e67925bba51/users/77a70a650a1e4944a812e9f3da790865/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.707114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7402ac590795448193276b1089e66b57', 'request_id': 'req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:23.716713 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2be5ff-65d6-4398-a444-229b47f4d7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a70e97cd9043b599851e67925bba51, user_id=77a70a650a1e4944a812e9f3da790865, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.718584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] The token cache is being invalidate because project 7402ac590795448193276b1089e66b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:23.718914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:23.719570 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9c3ba8f0-a3a6-4d20-865e-cb88d6c28730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:23.720467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2be5ff-65d6-4398-a444-229b47f4d7f2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.721124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1358/2701] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:23 2022] DELETE /identity/v3/projects/7402ac590795448193276b1089e66b57 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:23.726416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c0ce-6620-4af6-b3b5-672bca3b4e42 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.726950 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c0ce-6620-4af6-b3b5-672bca3b4e42 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.727446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c0ce-6620-4af6-b3b5-672bca3b4e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.745762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b623c0ce-6620-4af6-b3b5-672bca3b4e42 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:23.746971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b623c0ce-6620-4af6-b3b5-672bca3b4e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:23.755808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1359/2702] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:23.768111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b3e6-3797-4bad-90d2-3aad2b4ff9e0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.768111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b3e6-3797-4bad-90d2-3aad2b4ff9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.768111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b3e6-3797-4bad-90d2-3aad2b4ff9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.782206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1a59b3e6-3797-4bad-90d2-3aad2b4ff9e0 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:23.783428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1a59b3e6-3797-4bad-90d2-3aad2b4ff9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:23.792119 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1360/2703] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:23.793398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1344/2704] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:23 2022] PUT /identity/v3/projects/45a70e97cd9043b599851e67925bba51/users/77a70a650a1e4944a812e9f3da790865/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:23.799526 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59b3e6-3797-4bad-90d2-3aad2b4ff9e0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.805587 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229738-b585-475e-879b-29030a309f67 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.806461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229738-b585-475e-879b-29030a309f67 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.806461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229738-b585-475e-879b-29030a309f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.809860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59b3e6-3797-4bad-90d2-3aad2b4ff9e0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.832869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-26229738-b585-475e-879b-29030a309f67 None None] MFA Rules not processed for user `77a70a650a1e4944a812e9f3da790865`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:23.834086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-26229738-b585-475e-879b-29030a309f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:23.872948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.873617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.873903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.874180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.874942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:23.875251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.876903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.892060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1361/2705] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:23.894120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:23.894307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.902505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1345/2706] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:23.904997 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ab1c9-805c-4d9b-9930-97f31d3ab45f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.906930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229738-b585-475e-879b-29030a309f67 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:23.908395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-26229738-b585-475e-879b-29030a309f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:23.909752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.910446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.911282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.911571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.912273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.915060 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:23.931277 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229738-b585-475e-879b-29030a309f67 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:23.937114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:23.937801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:23.938109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:23.938383 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:23.939183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:23.941518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.022491 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1346/2707] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:23 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:24.024224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.025984 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:24.029845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1362/2708] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:23 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:24.029845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.077922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:24.085979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb219b6-7983-4504-82be-7e451cba988d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.092038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d52d5-5ebb-4653-9d88-5e01301008f3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.096838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.097514 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.097800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.098106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.098837 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.100830 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.135503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.136195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.136471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.136756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.138556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:24.180892 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1363/2709] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:24 2022] POST /identity/v3/users => generated 308 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:24.181787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.191682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1522c-3d9e-475b-8371-582e31e84b6b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.196517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.197173 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.197459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.197741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.198455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.200429 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.202808 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.204389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.214380 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1347/2710] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:24.215222 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.226505 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb838e8-d044-464d-b766-5f44f9cbcfcf service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.231484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.232202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.232490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.232772 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.233494 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.235107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.245956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1348/2711] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:24.249986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.260214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d3f2-b3c8-41a9-b493-060c349d7ec2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.264920 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.267517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.267517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.267517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] PATH_INFO: `/v3/projects/92ccfb80d75d4c1c8ad0a6f7768bd43d/users/8c828d8c152b4aedaa0af0cd1c948a53/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.274390 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1364/2712] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:24 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:24.279852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.287904 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ccfb80d75d4c1c8ad0a6f7768bd43d, user_id=8c828d8c152b4aedaa0af0cd1c948a53, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.291491 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc049c-b021-4a2b-b1b2-7df05ee591f0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.291635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.297124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.297793 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.298079 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.298359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.299135 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.300924 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.312021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1365/2713] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:24.316155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.326535 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540772b-b7cc-474f-bf33-653a7f85e025 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.331866 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.332505 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.332783 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.336684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.336684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.336684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.346702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1366/2714] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:24.350421 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.360195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1349/2715] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:24 2022] PUT /identity/v3/projects/92ccfb80d75d4c1c8ad0a6f7768bd43d/users/8c828d8c152b4aedaa0af0cd1c948a53/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:24.364077 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.366088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92600c5-7347-4547-a40a-547a60bfde9a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.373943 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:24.424653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de607fc2-4523-478c-96b2-38c897db8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.425692 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607fc2-4523-478c-96b2-38c897db8d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.426090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607fc2-4523-478c-96b2-38c897db8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.426418 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607fc2-4523-478c-96b2-38c897db8d03 admin admin] PATH_INFO: `/v3/projects/131719a1fac8400e915e44fd94aea692/users/66d712db49e04c6d90f9332ac39bd926/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.431882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5964-e7c7-423a-82d3-3191dc7d0218 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.438079 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.438778 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.439062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.439336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.440097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.441688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.443850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607fc2-4523-478c-96b2-38c897db8d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131719a1fac8400e915e44fd94aea692, user_id=66d712db49e04c6d90f9332ac39bd926, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.447351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607fc2-4523-478c-96b2-38c897db8d03 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.453488 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1350/2716] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:24.467086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.468305 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cc5a4-4fd6-40a5-9000-403ef19b0556 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.472918 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e1908-8b1c-49a4-b882-034522f2d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.473813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1908-8b1c-49a4-b882-034522f2d6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.474095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1908-8b1c-49a4-b882-034522f2d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.474369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e1908-8b1c-49a4-b882-034522f2d6ec admin admin] PATH_INFO: `/v3/projects/92ccfb80d75d4c1c8ad0a6f7768bd43d/users/8c828d8c152b4aedaa0af0cd1c948a53/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.476762 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1908-8b1c-49a4-b882-034522f2d6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ccfb80d75d4c1c8ad0a6f7768bd43d, user_id=8c828d8c152b4aedaa0af0cd1c948a53, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.480022 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e1908-8b1c-49a4-b882-034522f2d6ec admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.490795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1351/2717] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:24 2022] PUT /identity/v3/projects/92ccfb80d75d4c1c8ad0a6f7768bd43d/users/8c828d8c152b4aedaa0af0cd1c948a53/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:24.501600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.501600 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.501836 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.530962 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1367/2718] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:24 2022] PUT /identity/v3/projects/131719a1fac8400e915e44fd94aea692/users/66d712db49e04c6d90f9332ac39bd926/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:24.535548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] MFA Rules not processed for user `8c828d8c152b4aedaa0af0cd1c948a53`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:24.537089 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:24.596509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e85f5-1294-4d45-8b1b-93dbb3d55c36 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.596807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e85f5-1294-4d45-8b1b-93dbb3d55c36 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.599756 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e85f5-1294-4d45-8b1b-93dbb3d55c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.616898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1352/2719] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:24.626204 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-039e85f5-1294-4d45-8b1b-93dbb3d55c36 None None] MFA Rules not processed for user `66d712db49e04c6d90f9332ac39bd926`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:24.627851 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-039e85f5-1294-4d45-8b1b-93dbb3d55c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:24.628005 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.629331 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:24.686566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ad0b7-215c-491e-8562-c0c8dfacbb67 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.689724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.691044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.696854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.696854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.697242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1368/2720] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:24.700611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e85f5-1294-4d45-8b1b-93dbb3d55c36 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.702415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.703973 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.710077 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:24.714617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1353/2721] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:24.766384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e85f5-1294-4d45-8b1b-93dbb3d55c36 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.771103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.771780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.772071 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.772407 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.773168 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.782768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.862782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.876545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f9b5-6ec6-4ec3-bd99-50e89a499a04 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.881103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.882087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.883129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.883443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] PATH_INFO: `/v3/users/77a70a650a1e4944a812e9f3da790865` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.884693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a70a650a1e4944a812e9f3da790865)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.886607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:24.890162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1369/2722] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:24 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:24.893942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:24.900902 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:24.957744 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ff07d-b9f0-461f-9a06-e9aa54e3f048 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:24.963248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:24.963859 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:24.964149 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:24.964431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:24.965247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:24.967206 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:25.088651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1370/2723] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:24 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:25.092548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:25.103280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e27c-2b6e-4b4e-a634-17254ed5205d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:25.107955 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:25.108618 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.109000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.109217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.109969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:25.111599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:25.122289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1371/2724] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:25.125042 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a70a650a1e4944a812e9f3da790865'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:25.126580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:25.136964 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232edc-ed8f-4d45-841a-25a29ca4af69 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:25.140358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a70a650a1e4944a812e9f3da790865'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:25.140358 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a70a650a1e4944a812e9f3da790865'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:25.141714 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:25.142590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.142918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.143202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] PATH_INFO: `/v3/projects/69826466d5964db0b5edcbfe37713109/users/6748419a2b7142f98263687e5aff7dcf/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.158804 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69826466d5964db0b5edcbfe37713109, user_id=6748419a2b7142f98263687e5aff7dcf, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:25.161554 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:25.209401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a70a650a1e4944a812e9f3da790865'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:25.210041 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8a521f0-2d9e-4761-9d8e-92099ebbc831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a70a650a1e4944a812e9f3da790865'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:25.223562 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1354/2725] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:24 2022] DELETE /identity/v3/users/77a70a650a1e4944a812e9f3da790865 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:25.228492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.228784 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.229091 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.246216 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:25.247465 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:25.255559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1372/2726] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:25 2022] PUT /identity/v3/projects/69826466d5964db0b5edcbfe37713109/users/6748419a2b7142f98263687e5aff7dcf/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:25.261893 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:25.263803 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:25.308379 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1355/2727] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:25.314221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:25.318139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:25.320327 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:25.330001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feb375-5f0d-4c69-9447-d0f7c31ccc28 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:25.334874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:25.336378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.336667 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.336977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.337717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:25.339417 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:25.350495 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1373/2728] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:25.356373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:25.364780 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ddb14-fb66-4ecd-bd02-f9762b6eb0ab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:25.369888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1536c9-1fef-4a8e-8509-c3553528c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:25.370838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1536c9-1fef-4a8e-8509-c3553528c86f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.371128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1536c9-1fef-4a8e-8509-c3553528c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.371409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1536c9-1fef-4a8e-8509-c3553528c86f admin admin] PATH_INFO: `/v3/projects/69826466d5964db0b5edcbfe37713109/users/6748419a2b7142f98263687e5aff7dcf/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.373541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1536c9-1fef-4a8e-8509-c3553528c86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69826466d5964db0b5edcbfe37713109, user_id=6748419a2b7142f98263687e5aff7dcf, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:25.376701 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1536c9-1fef-4a8e-8509-c3553528c86f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:25.379725 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e38e-7413-4fc0-81c3-023bcad2d970 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:25.384513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:25.385201 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.385504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.385789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.388580 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1374/2729] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:25 2022] PUT /identity/v3/projects/69826466d5964db0b5edcbfe37713109/users/6748419a2b7142f98263687e5aff7dcf/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:25.396764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:25.398967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:25.406899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.407247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.407726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.409433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1356/2730] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:25.436682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] MFA Rules not processed for user `6748419a2b7142f98263687e5aff7dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:25.437888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:25.518209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1375/2731] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:25.533278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:25.534758 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:25.571988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:25.609817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb63f-0f9e-4486-9705-943554b918da service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:25.672790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:25.673443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.673731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.674006 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.684063 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:25.685513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:25.695965 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1357/2732] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:25.829748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:25.832027 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:25.908392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ffc3c-7d91-40f8-907f-c3bdde4b5628 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:25.913049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:25.914516 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:25.914860 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:25.915125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] PATH_INFO: `/v3/projects/45a70e97cd9043b599851e67925bba51` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:25.916347 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a70e97cd9043b599851e67925bba51)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:25.918572 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:26.043785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a70e97cd9043b599851e67925bba51', 'request_id': 'req-8e19db30-ee16-4acb-9ef8-408b5e77265f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.123348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a70e97cd9043b599851e67925bba51', 'request_id': 'req-8e19db30-ee16-4acb-9ef8-408b5e77265f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.125709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:26.129726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a70e97cd9043b599851e67925bba51', 'request_id': 'req-8e19db30-ee16-4acb-9ef8-408b5e77265f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.140799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] The token cache is being invalidate because project 45a70e97cd9043b599851e67925bba51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:26.141091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.141727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.143341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1376/2733] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:25 2022] DELETE /identity/v3/projects/45a70e97cd9043b599851e67925bba51 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:26.147362 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:26.158467 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eee4f-cb25-42fb-9ccc-3122f858d8e7 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:26.216826 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:26.218375 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:26.218881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:26.219194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] PATH_INFO: `/v3/users/8c828d8c152b4aedaa0af0cd1c948a53` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:26.220461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c828d8c152b4aedaa0af0cd1c948a53)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:26.222382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:26.438694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c828d8c152b4aedaa0af0cd1c948a53'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.453372 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c828d8c152b4aedaa0af0cd1c948a53'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.454137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c828d8c152b4aedaa0af0cd1c948a53'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.568149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c828d8c152b4aedaa0af0cd1c948a53'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.574881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c828d8c152b4aedaa0af0cd1c948a53'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:26.583066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1358/2734] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:26 2022] DELETE /identity/v3/users/8c828d8c152b4aedaa0af0cd1c948a53 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:26.898772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:26.900759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:26.913378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19db30-ee16-4acb-9ef8-408b5e77265f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:26.970503 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:26.971336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:26.971628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:26.971906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] PATH_INFO: `/v3/users/66d712db49e04c6d90f9332ac39bd926` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:26.973222 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d712db49e04c6d90f9332ac39bd926)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:26.975114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:27.155888 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d712db49e04c6d90f9332ac39bd926'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.171682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d712db49e04c6d90f9332ac39bd926'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.302247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:27.303779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:27.317463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2949451-7155-4bc0-9a99-95753489d085 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:27.322850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:27.323721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.324014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.324296 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] PATH_INFO: `/v3/projects/92ccfb80d75d4c1c8ad0a6f7768bd43d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.325496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ccfb80d75d4c1c8ad0a6f7768bd43d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:27.327571 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:27.334549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:27.335809 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d712db49e04c6d90f9332ac39bd926'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.336599 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d712db49e04c6d90f9332ac39bd926'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.337262 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6bae04a-9665-4aaa-9a96-36aa9b374a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d712db49e04c6d90f9332ac39bd926'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.350351 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1377/2735] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:26 2022] DELETE /identity/v3/users/66d712db49e04c6d90f9332ac39bd926 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:27.355643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.356011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.356378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.374577 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:27.375850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:27.434607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1378/2736] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:27.444460 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:27.445943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:27.446406 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ccfb80d75d4c1c8ad0a6f7768bd43d', 'request_id': 'req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.453142 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ccfb80d75d4c1c8ad0a6f7768bd43d', 'request_id': 'req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.455728 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:27.460116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ccfb80d75d4c1c8ad0a6f7768bd43d', 'request_id': 'req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.503661 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c600529-29af-441c-9298-d6c1202b0f18 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:27.540476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] The token cache is being invalidate because project 92ccfb80d75d4c1c8ad0a6f7768bd43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:27.541139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.541869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62e3ddaa-e405-43b6-81ec-5ac1fb606a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:27.544031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1359/2737] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:27 2022] DELETE /identity/v3/projects/92ccfb80d75d4c1c8ad0a6f7768bd43d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:27.548734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049953-e13e-4523-9a35-40acaf803073 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.548964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049953-e13e-4523-9a35-40acaf803073 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.549247 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049953-e13e-4523-9a35-40acaf803073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.559124 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:27.559903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.560303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.561013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.563051 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:27.571733 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a1049953-e13e-4523-9a35-40acaf803073 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:27.573107 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a1049953-e13e-4523-9a35-40acaf803073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:27.629960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:27.631445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:27.636582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1360/2738] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:27.644306 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81c98-632e-4660-91ec-0f83952727a1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.644677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81c98-632e-4660-91ec-0f83952727a1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.644958 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f81c98-632e-4660-91ec-0f83952727a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.648207 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1379/2739] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:27.663485 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-56f81c98-632e-4660-91ec-0f83952727a1 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:27.665319 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-56f81c98-632e-4660-91ec-0f83952727a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:27.674074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1361/2740] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:27.678134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:27.688401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a70538-1e74-45eb-9561-23582a6a7dca service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:27.693878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:27.694548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.694879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.695155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.695987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:27.696303 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:27.697922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:27.711653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1380/2741] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:27.715926 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81c98-632e-4660-91ec-0f83952727a1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:27.726627 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f81c98-632e-4660-91ec-0f83952727a1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:27.731407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:27.732122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.732409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.732689 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.733386 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:27.735449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:27.856168 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1362/2742] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:27 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:27.857733 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:27.868551 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43b94d-931b-4bdf-9923-52e2debd7ecd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:27.932049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:27.933137 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:27.933473 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:27.933764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:27.934853 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:27.936763 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:27.947184 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:28.078231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1381/2743] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:27 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:28.082280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.094112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce946-849f-41d3-b3ef-099a60428711 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.105586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.105907 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.106605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.106912 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.107194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.108933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:28.109099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.109830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.128080 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23710f-6a75-4487-9b7e-8f1f942d741e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.134209 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.139606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.139606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.139606 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] PATH_INFO: `/v3/projects/131719a1fac8400e915e44fd94aea692` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.140639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1363/2744] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:28.141697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=131719a1fac8400e915e44fd94aea692)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.141697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.142701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.155979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df20c-d088-472b-ba22-5d50c649b0db admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.161060 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.161605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.162164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.163470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.170673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.170673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.178612 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1364/2745] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:28.185456 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.193745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6d0d7-6447-44e3-b11b-1c7279b60d87 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.198693 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f4def-38c4-4500-ad72-a63c0bf8c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.199610 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f4def-38c4-4500-ad72-a63c0bf8c9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.199900 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f4def-38c4-4500-ad72-a63c0bf8c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.200177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f4def-38c4-4500-ad72-a63c0bf8c9e4 admin admin] PATH_INFO: `/v3/projects/d1b35269bf37428a999a1ac7a3195ff9/users/26fea48323cd4563a11b0bc37c77f112/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.216639 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f4def-38c4-4500-ad72-a63c0bf8c9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b35269bf37428a999a1ac7a3195ff9, user_id=26fea48323cd4563a11b0bc37c77f112, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.219402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f4def-38c4-4500-ad72-a63c0bf8c9e4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.312324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1365/2746] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:28 2022] PUT /identity/v3/projects/d1b35269bf37428a999a1ac7a3195ff9/users/26fea48323cd4563a11b0bc37c77f112/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:28.321456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131719a1fac8400e915e44fd94aea692', 'request_id': 'req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.324804 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.325088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.325369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.359156 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] MFA Rules not processed for user `26fea48323cd4563a11b0bc37c77f112`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:28.360369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:28.369454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:28.380737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131719a1fac8400e915e44fd94aea692', 'request_id': 'req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.389252 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131719a1fac8400e915e44fd94aea692', 'request_id': 'req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.402218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] The token cache is being invalidate because project 131719a1fac8400e915e44fd94aea692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:28.402592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.403362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.405007 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1382/2747] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:28 2022] DELETE /identity/v3/projects/131719a1fac8400e915e44fd94aea692 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:28.408971 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.410231 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:28.433754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1366/2748] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:28.438673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.440028 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:28.474748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed920f8-ab28-41b4-9dcb-c69a6661a1cc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.479767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.480646 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.480930 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.481205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] PATH_INFO: `/v3/users/6748419a2b7142f98263687e5aff7dcf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.482408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6748419a2b7142f98263687e5aff7dcf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.484372 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.515449 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70fd9-0262-4bd9-bc4c-aec008afecd3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.520891 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.521554 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.521840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.522118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.523777 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.527122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.656680 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1367/2749] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:28 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:28.660503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.725929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6689c-0a8f-4fd4-8865-9e1e34e8e594 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.730979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.731765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.732058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.732340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.733031 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.734987 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.743356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6748419a2b7142f98263687e5aff7dcf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.756986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6748419a2b7142f98263687e5aff7dcf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.826126 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1368/2750] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:28 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:28.830050 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.840553 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550dd8e-058e-4fc8-a06b-9055b7e54f1d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.845101 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.845742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.846024 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.846442 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.847087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.848694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:28.850762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6748419a2b7142f98263687e5aff7dcf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.852068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6748419a2b7142f98263687e5aff7dcf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.852908 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6748419a2b7142f98263687e5aff7dcf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:28.855546 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=5,keystone:SELECT=78,keystone:DELETE=17 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:28.860340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1369/2751] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:28.864504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:28.866137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:28.868479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1383/2752] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:28 2022] DELETE /identity/v3/users/6748419a2b7142f98263687e5aff7dcf => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:28.883219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c584b-cc7f-419d-aa0c-f313c910b07e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:28.893192 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:28.943729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:28.944632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:28.944939 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:28.945276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] PATH_INFO: `/v3/projects/d6da13dc7a4a469a9e06e674eb9393e0/users/53a92e065ce844c7b117ad1e7db7cc1a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:28.959980 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6da13dc7a4a469a9e06e674eb9393e0, user_id=53a92e065ce844c7b117ad1e7db7cc1a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:28.962662 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:29.084300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1370/2753] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:28 2022] PUT /identity/v3/projects/d6da13dc7a4a469a9e06e674eb9393e0/users/53a92e065ce844c7b117ad1e7db7cc1a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:29.088459 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:29.098380 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d585e4-9230-45ae-9a01-d6e16d064e4f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:29.157197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b682e4-0486-4bf8-9808-b0ebf6600e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:29.157870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b682e4-0486-4bf8-9808-b0ebf6600e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:29.158160 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b682e4-0486-4bf8-9808-b0ebf6600e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:29.158439 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b682e4-0486-4bf8-9808-b0ebf6600e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:29.159203 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b682e4-0486-4bf8-9808-b0ebf6600e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:29.160885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b682e4-0486-4bf8-9808-b0ebf6600e5d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:29.174890 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1384/2754] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:29.176953 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:29.187962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e990608-7acb-45d2-b371-bfe60008a2d1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:29.193138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:29.194106 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:29.194310 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:29.194619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] PATH_INFO: `/v3/projects/d6da13dc7a4a469a9e06e674eb9393e0/users/53a92e065ce844c7b117ad1e7db7cc1a/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:29.199760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6da13dc7a4a469a9e06e674eb9393e0, user_id=53a92e065ce844c7b117ad1e7db7cc1a, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:29.199760 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:29.210021 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1371/2755] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:29 2022] PUT /identity/v3/projects/d6da13dc7a4a469a9e06e674eb9393e0/users/53a92e065ce844c7b117ad1e7db7cc1a/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:29.220586 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:29.220877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:29.221157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:29.250276 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] MFA Rules not processed for user `53a92e065ce844c7b117ad1e7db7cc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:29.251607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:29.319620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1385/2756] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:29.330393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:29.332199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:29.367180 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:29.371373 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:29.415080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92f0dc-48ad-4fac-b918-96e9575743f3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:29.416297 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9a363-7001-4767-8767-4b76d225f9e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:29.416957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a363-7001-4767-8767-4b76d225f9e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:29.417272 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a363-7001-4767-8767-4b76d225f9e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:29.417573 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a363-7001-4767-8767-4b76d225f9e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:29.436961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9a363-7001-4767-8767-4b76d225f9e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:29.436961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9a363-7001-4767-8767-4b76d225f9e1 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:29.442991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1372/2757] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:29.448259 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f88e4-3e66-4adb-81b2-a0b3f3491b09 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:29.452856 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:29.453862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:29.454004 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:29.454278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] PATH_INFO: `/v3/projects/69826466d5964db0b5edcbfe37713109` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:29.455511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69826466d5964db0b5edcbfe37713109)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:29.457391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:29.475470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:29.639699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69826466d5964db0b5edcbfe37713109', 'request_id': 'req-f55b3cc2-f8e9-4684-9352-0bd3e742c829'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:29.740876 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69826466d5964db0b5edcbfe37713109', 'request_id': 'req-f55b3cc2-f8e9-4684-9352-0bd3e742c829'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:29.753151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69826466d5964db0b5edcbfe37713109', 'request_id': 'req-f55b3cc2-f8e9-4684-9352-0bd3e742c829'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:29.765436 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] The token cache is being invalidate because project 69826466d5964db0b5edcbfe37713109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:29.765871 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:29.766568 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f55b3cc2-f8e9-4684-9352-0bd3e742c829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:29.768327 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1386/2758] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:29 2022] DELETE /identity/v3/projects/69826466d5964db0b5edcbfe37713109 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:29.773927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c005-4193-4049-9adf-fbf4ef19aeea None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:29.774217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c005-4193-4049-9adf-fbf4ef19aeea None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:29.774501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22c005-4193-4049-9adf-fbf4ef19aeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:29.793925 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0a22c005-4193-4049-9adf-fbf4ef19aeea None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:29.795186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0a22c005-4193-4049-9adf-fbf4ef19aeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:29.988632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1373/2759] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:29.998727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd6a4-5189-4674-8794-19416d47bf7f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:29.999024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd6a4-5189-4674-8794-19416d47bf7f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:29.999306 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd6a4-5189-4674-8794-19416d47bf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.018010 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-830dd6a4-5189-4674-8794-19416d47bf7f None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:30.019256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-830dd6a4-5189-4674-8794-19416d47bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:30.027479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1387/2760] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:30.031934 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22c005-4193-4049-9adf-fbf4ef19aeea None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.042521 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22c005-4193-4049-9adf-fbf4ef19aeea None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.047884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.048700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.048843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.049136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.049822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:30.050123 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.051720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:30.064673 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1374/2761] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:30.069154 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dd6a4-5189-4674-8794-19416d47bf7f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.079091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dd6a4-5189-4674-8794-19416d47bf7f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.083808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.084462 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.084750 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.085031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.085742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.087687 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:30.193298 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1388/2762] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:30 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:30.199081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.208280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbfb31-4bd9-4dcc-b565-4767b30b62d4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.217438 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:30.267489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.268631 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.268917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.269193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.269884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.271868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:30.346298 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1375/2763] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:30 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:30.350435 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.361201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbb5fd-478f-49ab-8156-8cb37bb4a7b5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.365881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.366538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.367494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.367799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.368528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.372883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:30.389747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1389/2764] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:30.390592 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.401755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c3393-e5f4-4b04-be84-f921abfa85b8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.407105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c22c0-7622-45b9-a5e9-aa10e7d3f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.407774 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c22c0-7622-45b9-a5e9-aa10e7d3f72a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.408057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c22c0-7622-45b9-a5e9-aa10e7d3f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.408334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c22c0-7622-45b9-a5e9-aa10e7d3f72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.409071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c22c0-7622-45b9-a5e9-aa10e7d3f72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.410751 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c22c0-7622-45b9-a5e9-aa10e7d3f72a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:30.422779 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1376/2765] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:30.427158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.438069 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc217d-73a4-41ad-b9f6-b468c21e009b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.442790 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.443672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.443961 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.444242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] PATH_INFO: `/v3/projects/e01d6058fb4b4dd79c7c4bbac23f2f4a/users/d9baad406303498a9cac96c42fad9aec/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.458944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01d6058fb4b4dd79c7c4bbac23f2f4a, user_id=d9baad406303498a9cac96c42fad9aec, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.461902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:30.558990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1390/2766] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:30 2022] PUT /identity/v3/projects/e01d6058fb4b4dd79c7c4bbac23f2f4a/users/d9baad406303498a9cac96c42fad9aec/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:30.572046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030423-f733-44da-85a1-3be3182223b5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.572339 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030423-f733-44da-85a1-3be3182223b5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.572617 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030423-f733-44da-85a1-3be3182223b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.602880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3d030423-f733-44da-85a1-3be3182223b5 None None] MFA Rules not processed for user `d9baad406303498a9cac96c42fad9aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:30.604092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3d030423-f733-44da-85a1-3be3182223b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:30.668390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1377/2767] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:30.672923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.744414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19a4c2-0b82-43b6-96c3-17fd80c7d915 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.749282 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.752643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.752643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.752643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.752643 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.753142 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:30.851237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1391/2768] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:30 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:30.855861 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030423-f733-44da-85a1-3be3182223b5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:30.867141 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030423-f733-44da-85a1-3be3182223b5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:30.924229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:30.924897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:30.925181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:30.925461 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:30.926137 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:30.928081 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.031337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1378/2769] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:30 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:31.035202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.048464 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e2c0-ab8d-4f93-b5e3-a071de3228ab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.053442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.054129 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.054631 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.057442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.057442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.057442 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.071666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1392/2770] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:31.075711 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.087135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3196a-3520-4959-b82f-ffd06c42f46c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.091793 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd847c-5b18-481f-8df8-b2459177625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.092463 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd847c-5b18-481f-8df8-b2459177625c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.092752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd847c-5b18-481f-8df8-b2459177625c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.093062 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd847c-5b18-481f-8df8-b2459177625c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.093798 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd847c-5b18-481f-8df8-b2459177625c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.095427 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd847c-5b18-481f-8df8-b2459177625c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.100948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:31.108818 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1379/2771] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:31.120395 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.130386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad37ef9-71f9-4625-be6d-03f01382ebda admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.135834 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.137941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.137941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.137941 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] PATH_INFO: `/v3/projects/0ace7795f2ce4accbf101d3806714865/users/ba051077e940493981a3421f840bdd5c/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.150025 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:31.153974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ace7795f2ce4accbf101d3806714865, user_id=ba051077e940493981a3421f840bdd5c, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.156765 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.272169 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1393/2772] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:31 2022] PUT /identity/v3/projects/0ace7795f2ce4accbf101d3806714865/users/ba051077e940493981a3421f840bdd5c/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:31.283349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.283575 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.283854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.309489 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] MFA Rules not processed for user `ba051077e940493981a3421f840bdd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:31.310745 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:31.381447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1380/2773] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:31.387155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.402218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.402218 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:31.469829 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267f30-0606-4119-b139-d94af8875eec admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.474957 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.475674 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.475989 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.476335 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.477469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.479458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.481464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb19e1-6e12-4d5d-ac04-5115735f79bf None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.486139 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.487046 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.487334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.487611 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] PATH_INFO: `/v3/users/c0f26461216a43d59c65104bf51571af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.490766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f26461216a43d59c65104bf51571af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.490766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.604186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1394/2774] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:31 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:31.608393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.670918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47175-68a3-4bc0-b963-9bbaaeacef59 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.675621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.676326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.676617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.676899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.677585 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.680084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.706749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f26461216a43d59c65104bf51571af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:31.723983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f26461216a43d59c65104bf51571af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:31.724685 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f26461216a43d59c65104bf51571af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:31.785453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1395/2775] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:31 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:31.791408 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.793571 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:31.807162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f02c6-9e5e-4374-bc35-faf78d5eee18 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.807917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f26461216a43d59c65104bf51571af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:31.808929 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2b4a6ba1-b520-4f16-a95b-c5468abaa09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f26461216a43d59c65104bf51571af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:31.812242 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.818770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.818770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.818770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.818770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.818770 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.824724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1381/2776] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:31 2022] DELETE /identity/v3/users/c0f26461216a43d59c65104bf51571af => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:31.829400 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.829742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.829960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.833431 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1396/2777] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:31.834785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.844729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d96f0-2801-4faa-b75e-1a965bc2d6a1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:31.850007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:31.851868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:31.858213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:31.904566 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:31.914488 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:31.915419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:31.915696 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:31.916008 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] PATH_INFO: `/v3/projects/68c51bf2cd1749a5ba841121c9c7e889/users/344bf964824e4305adfaeaa08afd0044/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:31.926082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1382/2778] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:31.931899 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c51bf2cd1749a5ba841121c9c7e889, user_id=344bf964824e4305adfaeaa08afd0044, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:31.934613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:31.936402 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:31.937755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:31.995755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f12672-d4a7-4ddf-af2b-66e37ec7ed79 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:32.000792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:32.000792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.000792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.000792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.010496 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:32.011990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:32.022094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1397/2779] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:31 2022] PUT /identity/v3/projects/68c51bf2cd1749a5ba841121c9c7e889/users/344bf964824e4305adfaeaa08afd0044/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:32.022849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1383/2780] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:32.031232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:32.095629 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf00e9-163d-4066-9a01-63710e97f085 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:32.100349 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124e52b-33ce-4b71-a9d0-0311386950c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:32.101013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e52b-33ce-4b71-a9d0-0311386950c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.101898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e52b-33ce-4b71-a9d0-0311386950c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.101898 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e52b-33ce-4b71-a9d0-0311386950c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.102935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124e52b-33ce-4b71-a9d0-0311386950c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:32.104536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124e52b-33ce-4b71-a9d0-0311386950c2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:32.114735 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1398/2781] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:32.119692 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:32.129482 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d2b64-5aa1-408c-b1df-c6fe37ea08f2 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:32.135184 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:32.138332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.138332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.138332 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] PATH_INFO: `/v3/projects/68c51bf2cd1749a5ba841121c9c7e889/users/344bf964824e4305adfaeaa08afd0044/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.141240 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c51bf2cd1749a5ba841121c9c7e889, user_id=344bf964824e4305adfaeaa08afd0044, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:32.146436 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:32.155746 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1384/2782] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:32 2022] PUT /identity/v3/projects/68c51bf2cd1749a5ba841121c9c7e889/users/344bf964824e4305adfaeaa08afd0044/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:32.167388 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.167682 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.168212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.195427 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] MFA Rules not processed for user `344bf964824e4305adfaeaa08afd0044`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:32.196639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:32.268712 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1399/2783] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:32.281120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:32.283036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:32.360560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992b76-1a4a-4236-8406-0124738cbdb7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:32.360560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:32.360560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.360560 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.361099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.363508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:32.425903 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:32.430180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:32.431668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:32.440813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1385/2784] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:32.476917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:32.478402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:32.506788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:32.508801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:32.563354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:32.568727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3a5e8-39f0-41b2-b13f-60cd08608b82 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:32.574846 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:32.575737 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.576021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.576297 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] PATH_INFO: `/v3/users/26fea48323cd4563a11b0bc37c77f112` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.577509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fea48323cd4563a11b0bc37c77f112)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:32.579475 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:32.592159 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d2a1b-9113-4446-826d-5bcfb80e7bc3 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:32.597292 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:32.598237 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.598589 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.598957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] PATH_INFO: `/v3/projects/59b70946bfe4461d94043c1eaa3816f8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.600354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b70946bfe4461d94043c1eaa3816f8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:32.603537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:32.771302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fea48323cd4563a11b0bc37c77f112'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.771538 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b70946bfe4461d94043c1eaa3816f8', 'request_id': 'req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.776992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b70946bfe4461d94043c1eaa3816f8', 'request_id': 'req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.783328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b70946bfe4461d94043c1eaa3816f8', 'request_id': 'req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.784013 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fea48323cd4563a11b0bc37c77f112'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.865421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] The token cache is being invalidate because project 59b70946bfe4461d94043c1eaa3816f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:32.865709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.866325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.868516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1386/2785] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:32 2022] DELETE /identity/v3/projects/59b70946bfe4461d94043c1eaa3816f8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:32.872334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:32.873651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:32.937590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18109b3f-d1d8-4cbd-a1e8-ff0539f184c3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:32.939497 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fea48323cd4563a11b0bc37c77f112'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.940383 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fea48323cd4563a11b0bc37c77f112'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.941233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-85787350-d1b9-49c3-9296-11b9a01ea5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fea48323cd4563a11b0bc37c77f112'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:32.942349 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:32.943257 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.948618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.948618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] PATH_INFO: `/v3/users/fe98c2ac68a6452eaa4fa27e5d86a7c1` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.948618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe98c2ac68a6452eaa4fa27e5d86a7c1)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:32.948618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:32.955146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1400/2786] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:32 2022] DELETE /identity/v3/users/26fea48323cd4563a11b0bc37c77f112 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:32.959672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:32.959968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:32.960337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:32.979362 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:32.980493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:33.040263 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1401/2787] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:33.050332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:33.051923 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:33.057351 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:33.113045 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5722-8257-434f-a929-4784633e4da2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:33.116985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:33.117693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:33.118177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:33.118296 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:33.125076 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe98c2ac68a6452eaa4fa27e5d86a7c1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.129090 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:33.130813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:33.141461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1402/2788] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:33.144822 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe98c2ac68a6452eaa4fa27e5d86a7c1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.145821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe98c2ac68a6452eaa4fa27e5d86a7c1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.231789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe98c2ac68a6452eaa4fa27e5d86a7c1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.232495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe98c2ac68a6452eaa4fa27e5d86a7c1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.245828 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1387/2789] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:32 2022] DELETE /identity/v3/users/fe98c2ac68a6452eaa4fa27e5d86a7c1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:33.606014 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:33.607611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:33.622998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5eea8-9acf-43bb-9703-f88cf0398372 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:33.643637 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:33.683663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:33.684533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:33.684813 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:33.685087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] PATH_INFO: `/v3/projects/d1b35269bf37428a999a1ac7a3195ff9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:33.686271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b35269bf37428a999a1ac7a3195ff9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:33.688202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:33.715787 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:33.717470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:33.731604 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c950-f4cd-4221-b5f6-dc1b83446236 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:33.736618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:33.737472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:33.737846 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:33.738241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] PATH_INFO: `/v3/projects/05727978d9cc45fab80fe2eb19b3788b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:33.739700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05727978d9cc45fab80fe2eb19b3788b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:33.742161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:33.850114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b35269bf37428a999a1ac7a3195ff9', 'request_id': 'req-05e0de51-c673-4e6e-a319-e03a3bb04c4e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.850448 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05727978d9cc45fab80fe2eb19b3788b', 'request_id': 'req-ea570f88-0266-4569-8827-0b9ae46ee173'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.857086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05727978d9cc45fab80fe2eb19b3788b', 'request_id': 'req-ea570f88-0266-4569-8827-0b9ae46ee173'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.863434 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05727978d9cc45fab80fe2eb19b3788b', 'request_id': 'req-ea570f88-0266-4569-8827-0b9ae46ee173'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.922323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b35269bf37428a999a1ac7a3195ff9', 'request_id': 'req-05e0de51-c673-4e6e-a319-e03a3bb04c4e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.929699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b35269bf37428a999a1ac7a3195ff9', 'request_id': 'req-05e0de51-c673-4e6e-a319-e03a3bb04c4e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.941218 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] The token cache is being invalidate because project d1b35269bf37428a999a1ac7a3195ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:33.941506 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.942152 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:33.943729 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1403/2790] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:33 2022] DELETE /identity/v3/projects/d1b35269bf37428a999a1ac7a3195ff9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:33.948456 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:33.951002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.017161 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0de51-c673-4e6e-a319-e03a3bb04c4e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.020849 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] The token cache is being invalidate because project 05727978d9cc45fab80fe2eb19b3788b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:34.021162 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:34.021817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ea570f88-0266-4569-8827-0b9ae46ee173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:34.023990 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1388/2791] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:33 2022] DELETE /identity/v3/projects/05727978d9cc45fab80fe2eb19b3788b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:34.028688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156fff-40bc-4a66-9e47-ee9e161645bd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.028971 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156fff-40bc-4a66-9e47-ee9e161645bd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.029253 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156fff-40bc-4a66-9e47-ee9e161645bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.050227 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4a156fff-40bc-4a66-9e47-ee9e161645bd None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:34.051511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4a156fff-40bc-4a66-9e47-ee9e161645bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.077926 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.078865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.079156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.085099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] PATH_INFO: `/v3/users/53a92e065ce844c7b117ad1e7db7cc1a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.085099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a92e065ce844c7b117ad1e7db7cc1a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.085099 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.109089 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:34.119333 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1389/2792] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:34.126582 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0f38-bce7-4bd3-a749-1dcbe58ba5a8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.126909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0f38-bce7-4bd3-a749-1dcbe58ba5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.127300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e0f38-bce7-4bd3-a749-1dcbe58ba5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.146430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c72e0f38-bce7-4bd3-a749-1dcbe58ba5a8 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:34.147677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c72e0f38-bce7-4bd3-a749-1dcbe58ba5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.158522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1390/2793] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:34.161199 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0f38-bce7-4bd3-a749-1dcbe58ba5a8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.171656 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e0f38-bce7-4bd3-a749-1dcbe58ba5a8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.176479 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.177134 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.177423 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.177706 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.178433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:34.178799 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.181133 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.193428 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1391/2794] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 15:42:34.197957 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.207548 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9c8b-9a1a-4d64-8a33-449f4cb09ac2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.212720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.213355 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.213635 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.213909 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.214595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.216551 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.220009 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:34.222848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a92e065ce844c7b117ad1e7db7cc1a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:34.235430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a92e065ce844c7b117ad1e7db7cc1a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:34.317502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a92e065ce844c7b117ad1e7db7cc1a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:34.318239 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a92e065ce844c7b117ad1e7db7cc1a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:34.319065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a92e065ce844c7b117ad1e7db7cc1a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:34.328167 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1392/2795] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:34 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:34.329264 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.331404 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.338865 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1404/2796] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:33 2022] DELETE /identity/v3/users/53a92e065ce844c7b117ad1e7db7cc1a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:34.362057 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.363675 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.405717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3afea7-6c7b-4e43-9b21-9892597e9984 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.435326 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfa867-7fc1-41cf-8053-cab09d41bddb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.439766 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.440562 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.440848 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.441123 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.443046 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.469083 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.469994 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.470281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.470549 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.471329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.473788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.509268 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.510787 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.520105 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1405/2797] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:34.553002 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1393/2798] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:34 2022] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:34.557151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.574669 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721a28c-02da-4161-9b2e-75f728824e0f service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.580191 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.581302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.581600 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.581880 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.583049 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.584721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.598095 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1406/2799] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:34.602741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.615183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b9d28-d901-4160-83e4-b2dbf69b65ae admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.621941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945b4b6-34da-4f48-bbb6-5c50db4b38d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.622795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b4b6-34da-4f48-bbb6-5c50db4b38d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.623129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b4b6-34da-4f48-bbb6-5c50db4b38d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.623418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945b4b6-34da-4f48-bbb6-5c50db4b38d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.624178 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945b4b6-34da-4f48-bbb6-5c50db4b38d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.625838 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945b4b6-34da-4f48-bbb6-5c50db4b38d8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.641471 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1394/2800] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:34.642721 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.655070 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7762d-aad8-4e72-b96f-84bb9f1299b7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.660011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.661158 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.661545 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.661720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] PATH_INFO: `/v3/projects/4699da50f6a24afca4ac974b34d97207/users/84942cd77ea14e84938284c2b4d5415c/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.680715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4699da50f6a24afca4ac974b34d97207, user_id=84942cd77ea14e84938284c2b4d5415c, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.683578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.687724 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:34.781508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1407/2801] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:34 2022] PUT /identity/v3/projects/4699da50f6a24afca4ac974b34d97207/users/84942cd77ea14e84938284c2b4d5415c/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:34.792623 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3a79-2faa-4d89-90a8-9df70660279d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.793484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3a79-2faa-4d89-90a8-9df70660279d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.793484 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3a79-2faa-4d89-90a8-9df70660279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.816838 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.818798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.831217 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-524c3a79-2faa-4d89-90a8-9df70660279d None None] MFA Rules not processed for user `84942cd77ea14e84938284c2b4d5415c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:34.832910 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-524c3a79-2faa-4d89-90a8-9df70660279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:34.886807 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60927ce5-b386-4c75-80a9-a39abb929aba admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.891831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.892699 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.892990 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.893260 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] PATH_INFO: `/v3/projects/d6da13dc7a4a469a9e06e674eb9393e0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.894632 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6da13dc7a4a469a9e06e674eb9393e0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.896915 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.907431 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:34.911328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1395/2802] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:34.915817 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3a79-2faa-4d89-90a8-9df70660279d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:34.926165 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3a79-2faa-4d89-90a8-9df70660279d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:34.930915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:34.931564 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:34.931850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:34.932129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:34.932819 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:34.934790 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:34.994334 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6da13dc7a4a469a9e06e674eb9393e0', 'request_id': 'req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:35.016908 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1396/2803] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:34 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:35.021120 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.066453 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6da13dc7a4a469a9e06e674eb9393e0', 'request_id': 'req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:35.073720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6da13dc7a4a469a9e06e674eb9393e0', 'request_id': 'req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:35.085141 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] The token cache is being invalidate because project d6da13dc7a4a469a9e06e674eb9393e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:35.086094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:35.087363 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aadcdcc1-be0f-4fc4-816c-8eab40f81ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:35.088953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1408/2804] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:34 2022] DELETE /identity/v3/projects/d6da13dc7a4a469a9e06e674eb9393e0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:35.090286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64c0e7-ceab-4e59-89d1-6bacbcb5f31a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.093935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314332-6b6f-4e23-8f05-5b0d6b170036 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.095313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314332-6b6f-4e23-8f05-5b0d6b170036 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.095607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33314332-6b6f-4e23-8f05-5b0d6b170036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.097169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.097937 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.098324 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.098736 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.099530 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.101594 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.117886 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-33314332-6b6f-4e23-8f05-5b0d6b170036 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:35.119201 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-33314332-6b6f-4e23-8f05-5b0d6b170036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:35.127498 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1409/2805] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:35.135867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2d0d-91a6-4014-bcc1-08ae68f51e82 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.136162 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2d0d-91a6-4014-bcc1-08ae68f51e82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.136448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd2d0d-91a6-4014-bcc1-08ae68f51e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.154944 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2dcd2d0d-91a6-4014-bcc1-08ae68f51e82 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:35.156301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2dcd2d0d-91a6-4014-bcc1-08ae68f51e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:35.164767 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1410/2806] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:35.168942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd2d0d-91a6-4014-bcc1-08ae68f51e82 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.177877 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd2d0d-91a6-4014-bcc1-08ae68f51e82 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.182736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.183368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.183673 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.183948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.184666 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:35.184974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.186584 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.198925 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1411/2807] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:35.199084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1397/2808] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:35.202998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.203209 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.204685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:35.215124 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd02afc-5c6d-4eab-9c00-2472bf3d169b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.219249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3729b9-ad54-476a-9384-2601eda3e5f3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.219961 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.220418 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.220705 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.220979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.221671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.223807 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.224155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.224812 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.225103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.225381 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.226187 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.227883 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.239289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1412/2809] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:35.244366 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.254125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae91c-9b30-4306-9a77-e90729359f2c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.259378 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.260247 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.260527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.260836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] PATH_INFO: `/v3/projects/64d502fa7269400da6c94c29e67f9f7a/users/4fd838f7f2b1461aa9014354557223c8/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.275982 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d502fa7269400da6c94c29e67f9f7a, user_id=4fd838f7f2b1461aa9014354557223c8, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.278762 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.296932 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1398/2810] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:35.297917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.341234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1413/2811] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:35 2022] PUT /identity/v3/projects/64d502fa7269400da6c94c29e67f9f7a/users/4fd838f7f2b1461aa9014354557223c8/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:35.345216 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.358876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdff9a-7d08-40d8-8475-c909f9801262 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.376189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:35.409003 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:35.412678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b6bb0-0ecd-47a9-8818-5e1179f27931 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.417522 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.418450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.418595 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.418764 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.419065 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.419354 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.419634 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.419917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.420035 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.420658 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.421548 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.422563 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.434155 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1414/2812] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:35.438157 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.448953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d59e-100f-4c9d-94b3-59bacbe35848 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.454200 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11a61-d1be-438f-adff-7ce4f3568907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.455117 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11a61-d1be-438f-adff-7ce4f3568907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.455401 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11a61-d1be-438f-adff-7ce4f3568907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.455672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11a61-d1be-438f-adff-7ce4f3568907 admin admin] PATH_INFO: `/v3/projects/64d502fa7269400da6c94c29e67f9f7a/users/4fd838f7f2b1461aa9014354557223c8/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.457940 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e11a61-d1be-438f-adff-7ce4f3568907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d502fa7269400da6c94c29e67f9f7a, user_id=4fd838f7f2b1461aa9014354557223c8, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.461273 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e11a61-d1be-438f-adff-7ce4f3568907 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.471509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1415/2813] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:35 2022] PUT /identity/v3/projects/64d502fa7269400da6c94c29e67f9f7a/users/4fd838f7f2b1461aa9014354557223c8/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:35.482776 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414964-50c3-4abb-a791-3d3250122cc2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.483063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414964-50c3-4abb-a791-3d3250122cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.483337 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414964-50c3-4abb-a791-3d3250122cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.495312 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1399/2814] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:35.503628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.512772 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63414964-50c3-4abb-a791-3d3250122cc2 None None] MFA Rules not processed for user `4fd838f7f2b1461aa9014354557223c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:35.513985 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63414964-50c3-4abb-a791-3d3250122cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:35.515466 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480e77-d639-491a-9190-e96d64c3f54f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.574154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.574870 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.575161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.575444 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.576169 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.577773 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.585426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1416/2815] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:35.587813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1400/2816] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:35.594730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63414964-50c3-4abb-a791-3d3250122cc2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.596640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.598408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:35.605902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63414964-50c3-4abb-a791-3d3250122cc2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.610613 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.611324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.611590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.611903 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.612626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.614270 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.624993 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1417/2817] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:35.629134 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.641531 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602974d2-8e2f-4a73-a348-b6e2a608f70f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.646289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.647215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.647494 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.647800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] PATH_INFO: `/v3/projects/4041369aeb6544ebbbea7a930378a9d6/users/89364925f42c424988162e2ec801628f/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.660922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420de57-1089-47f9-9e2b-358c4c1d0954 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.664437 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4041369aeb6544ebbbea7a930378a9d6, user_id=89364925f42c424988162e2ec801628f, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.665508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb384-f011-4799-a106-3e9d8ee78c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.666157 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb384-f011-4799-a106-3e9d8ee78c56 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.666452 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb384-f011-4799-a106-3e9d8ee78c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.666811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb384-f011-4799-a106-3e9d8ee78c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.667931 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.676613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb384-f011-4799-a106-3e9d8ee78c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.678080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb384-f011-4799-a106-3e9d8ee78c56 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:35.688314 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1401/2818] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:35.747684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1418/2819] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:35 2022] PUT /identity/v3/projects/4041369aeb6544ebbbea7a930378a9d6/users/89364925f42c424988162e2ec801628f/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:35.759313 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23f226-ba47-49fa-a441-7c65d54907c7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.759613 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23f226-ba47-49fa-a441-7c65d54907c7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.759899 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23f226-ba47-49fa-a441-7c65d54907c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.795233 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-af23f226-ba47-49fa-a441-7c65d54907c7 None None] MFA Rules not processed for user `89364925f42c424988162e2ec801628f`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:35.800917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-af23f226-ba47-49fa-a441-7c65d54907c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:35.870390 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1402/2820] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:35.883359 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:35.961608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:35.966019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003efa6e-91cc-4aa8-aee3-b8225ad54a3c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:35.971021 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:35.971694 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:35.971983 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:35.972255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:35.973061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:35.974996 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.011820 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23f226-ba47-49fa-a441-7c65d54907c7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.025210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:36.071071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23f226-ba47-49fa-a441-7c65d54907c7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.074722 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.075399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.075649 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.075930 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.077789 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:36.092294 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1419/2821] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:35 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:36.096289 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.149398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.150886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.160975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1403/2822] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:36.161639 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817562f-d48d-4ec6-8ced-0c966316b3ea admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.167519 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.168338 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.168625 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.168904 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.169607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.171614 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.202605 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.214415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41fb18-0907-43a0-859e-8ea3881bd539 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.218997 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.219941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.220224 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.220501 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] PATH_INFO: `/v3/users/84942cd77ea14e84938284c2b4d5415c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.221700 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84942cd77ea14e84938284c2b4d5415c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.223678 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.261233 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1420/2823] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:36 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:36.265165 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.275972 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba22f0a-7f8e-4ebd-9c84-1c8a0171e73e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.280654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.281302 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.281592 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.281874 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.282596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.284240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.295517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1421/2824] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:36.299344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.308672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5ac81-ee27-4dc8-ab5b-5d97b100f9f2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.313269 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.315126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.315126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.315126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.315126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.316660 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.327214 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1422/2825] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 15:42:36.330933 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.340663 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb6de-4c87-40a3-99d0-890ecedc8170 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.345258 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f1f0e-f393-45d3-93d5-3abc6a3d17df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.346114 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1f0e-f393-45d3-93d5-3abc6a3d17df admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.346391 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1f0e-f393-45d3-93d5-3abc6a3d17df admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.346693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1f0e-f393-45d3-93d5-3abc6a3d17df admin admin] PATH_INFO: `/v3/projects/d019253ce95d4250b092abc7e2daa1f4/users/57727c23ad1549d087a15e0b341dd2ad/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.362194 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f1f0e-f393-45d3-93d5-3abc6a3d17df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d019253ce95d4250b092abc7e2daa1f4, user_id=57727c23ad1549d087a15e0b341dd2ad, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.364984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f1f0e-f393-45d3-93d5-3abc6a3d17df admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.434236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84942cd77ea14e84938284c2b4d5415c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:36.447001 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84942cd77ea14e84938284c2b4d5415c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:36.447862 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84942cd77ea14e84938284c2b4d5415c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:36.455896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1423/2826] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:36 2022] PUT /identity/v3/projects/d019253ce95d4250b092abc7e2daa1f4/users/57727c23ad1549d087a15e0b341dd2ad/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:36.467153 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.467419 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.467717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.493968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] MFA Rules not processed for user `57727c23ad1549d087a15e0b341dd2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:36.495205 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:36.505915 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84942cd77ea14e84938284c2b4d5415c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:36.506511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a1f403e1-a16c-4c5a-a385-71cc21924be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84942cd77ea14e84938284c2b4d5415c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:36.521832 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1404/2827] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:36 2022] DELETE /identity/v3/users/84942cd77ea14e84938284c2b4d5415c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:36.527542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.527834 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.528113 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.549382 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:36.550593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:36.566785 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1424/2828] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:36.572038 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.575680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:36.581728 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:36.592492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:36.611972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1405/2829] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:36.622149 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.623640 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:36.644697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09eab-cafc-4c6c-a8a9-e0bc3fe470a7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.650817 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.651559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.651932 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.652220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.652943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.654847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.682066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fa977-087a-4608-a07a-0c78432a2a7d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.685628 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.686370 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.686668 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.686976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.696864 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.698334 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.707881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1406/2830] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:36.756649 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1425/2831] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:36 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:36.758337 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.768336 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8f287-5e57-4318-ac26-9803f567479f service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.826082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.826761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.827044 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.827325 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.828054 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.829946 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.891518 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1407/2832] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:36 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:36.892977 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.903987 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849072a3-639b-44ff-ac31-a68ac497cb3b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.909109 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.909781 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.910072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.910356 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.911126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.914006 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:36.926560 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1426/2833] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:36.931347 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:36.943100 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81dfeb-94c8-483a-9ed7-676c5d056106 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:36.949291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:36.950183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:36.950464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:36.950776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] PATH_INFO: `/v3/projects/a48d594e78344d3fb789053286a39b83/users/065ab78fe9dd4aa28a758ed8b22c0644/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:36.967132 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48d594e78344d3fb789053286a39b83, user_id=065ab78fe9dd4aa28a758ed8b22c0644, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:36.969931 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:37.056004 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1408/2834] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:36 2022] PUT /identity/v3/projects/a48d594e78344d3fb789053286a39b83/users/065ab78fe9dd4aa28a758ed8b22c0644/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:37.060452 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:37.071543 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5e13b-6ace-4215-98f2-b9803d38dd3a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:37.128301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:37.128973 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:37.129236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:37.129507 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:37.130219 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:37.131875 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:37.136235 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:37.138210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:37.147064 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1427/2835] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:37.148088 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:37.156215 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6453-faf9-46cd-ab1b-192f95e4d688 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:37.160311 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcb7e1-9e05-43cf-a7a1-f75a9f436903 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:37.161632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:37.162956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:37.163195 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:37.164322 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] PATH_INFO: `/v3/projects/4699da50f6a24afca4ac974b34d97207` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:37.165432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4699da50f6a24afca4ac974b34d97207)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:37.168597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:37.168697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5531f73-7799-4b37-9109-f4a5bffbcc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:37.169032 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5531f73-7799-4b37-9109-f4a5bffbcc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:37.169320 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5531f73-7799-4b37-9109-f4a5bffbcc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:37.169590 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5531f73-7799-4b37-9109-f4a5bffbcc1d admin admin] PATH_INFO: `/v3/projects/a48d594e78344d3fb789053286a39b83/users/065ab78fe9dd4aa28a758ed8b22c0644/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:37.171611 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5531f73-7799-4b37-9109-f4a5bffbcc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48d594e78344d3fb789053286a39b83, user_id=065ab78fe9dd4aa28a758ed8b22c0644, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:37.174316 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5531f73-7799-4b37-9109-f4a5bffbcc1d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:37.186054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1428/2836] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:37 2022] PUT /identity/v3/projects/a48d594e78344d3fb789053286a39b83/users/065ab78fe9dd4aa28a758ed8b22c0644/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:37.197340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:37.197559 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:37.197845 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:37.223794 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] MFA Rules not processed for user `065ab78fe9dd4aa28a758ed8b22c0644`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:37.225011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:37.259764 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:37.268196 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4699da50f6a24afca4ac974b34d97207', 'request_id': 'req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.273844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4699da50f6a24afca4ac974b34d97207', 'request_id': 'req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.280034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4699da50f6a24afca4ac974b34d97207', 'request_id': 'req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.289752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:37.295290 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1429/2837] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:42:37.306768 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:37.308127 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:37.352061 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] The token cache is being invalidate because project 4699da50f6a24afca4ac974b34d97207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:37.352409 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.353074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.354632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1409/2838] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:37 2022] DELETE /identity/v3/projects/4699da50f6a24afca4ac974b34d97207 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:37.358412 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:37.359720 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:37.367513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9a4f4-427c-45a3-b07b-a8990bd38328 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:37.415392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:37.416048 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:37.416403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:37.416617 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:37.419896 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:37.426401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd774f-b2a3-4771-bd7e-b1702d0c0da2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:37.433236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:37.433236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:37.433508 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:37.433741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] PATH_INFO: `/v3/users/4fd838f7f2b1461aa9014354557223c8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:37.435389 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd838f7f2b1461aa9014354557223c8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:37.437593 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:37.487626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:37.489414 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:37.500802 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1430/2839] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 15:42:37.632244 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd838f7f2b1461aa9014354557223c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.644477 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd838f7f2b1461aa9014354557223c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.645273 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd838f7f2b1461aa9014354557223c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.728268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd838f7f2b1461aa9014354557223c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.733135 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd838f7f2b1461aa9014354557223c8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:37.743067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1410/2840] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:37 2022] DELETE /identity/v3/users/4fd838f7f2b1461aa9014354557223c8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:38.212300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:38.223530 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be4f67-fdb9-490a-ab4e-abcd597740cc service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:38.289626 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:38.290499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:38.290831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:38.291131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] PATH_INFO: `/v3/projects/64d502fa7269400da6c94c29e67f9f7a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:38.292288 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d502fa7269400da6c94c29e67f9f7a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:38.294470 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:38.300867 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:38.397271 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d502fa7269400da6c94c29e67f9f7a', 'request_id': 'req-64c97e80-dccc-41ae-babf-27b4267018c9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:38.504992 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d502fa7269400da6c94c29e67f9f7a', 'request_id': 'req-64c97e80-dccc-41ae-babf-27b4267018c9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:38.512277 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d502fa7269400da6c94c29e67f9f7a', 'request_id': 'req-64c97e80-dccc-41ae-babf-27b4267018c9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:38.527241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] The token cache is being invalidate because project 64d502fa7269400da6c94c29e67f9f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:38.527241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:38.527241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:38.527241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1431/2841] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:38 2022] DELETE /identity/v3/projects/64d502fa7269400da6c94c29e67f9f7a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:38.608016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:38.609468 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:38.661451 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:38.675010 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17331048-a85a-4887-b80c-85ed356e8e4b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:38.729687 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d21738-ecab-4698-823a-b6dee2ea1bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:38.730258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d21738-ecab-4698-823a-b6dee2ea1bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:38.730545 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d21738-ecab-4698-823a-b6dee2ea1bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:38.730873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d21738-ecab-4698-823a-b6dee2ea1bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:38.732927 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-74d21738-ecab-4698-823a-b6dee2ea1bf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:38.799203 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d21738-ecab-4698-823a-b6dee2ea1bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:38.800661 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d21738-ecab-4698-823a-b6dee2ea1bf4 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:38.810619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1411/2842] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:40.790902 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:40.792324 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:40.858076 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c97e80-dccc-41ae-babf-27b4267018c9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:40.863322 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:40.867471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:40.867471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:40.867471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] PATH_INFO: `/v3/users/d9baad406303498a9cac96c42fad9aec` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:40.867471 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9baad406303498a9cac96c42fad9aec)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:40.868174 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:41.029189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9baad406303498a9cac96c42fad9aec'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.041615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9baad406303498a9cac96c42fad9aec'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.134202 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9baad406303498a9cac96c42fad9aec'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.134878 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9baad406303498a9cac96c42fad9aec'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.135492 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9baad406303498a9cac96c42fad9aec'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.148994 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1432/2843] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:40 2022] DELETE /identity/v3/users/d9baad406303498a9cac96c42fad9aec => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:41.153544 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:41.154014 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:41.154114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:41.172095 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:41.173289 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:41.233197 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1412/2844] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:41.243657 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:41.245248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:41.260286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:41.303272 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36ae18-6c1d-445f-82ce-3fa5268c998c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:41.307538 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:41.308185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:41.308472 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:41.308751 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:41.317653 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:41.319145 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:41.329323 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1433/2845] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:41.764666 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:41.766117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:41.780329 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc77a18-e838-4e1f-b4ca-c912929283f2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:41.785179 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:41.786536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:41.786886 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:41.787187 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] PATH_INFO: `/v3/projects/e01d6058fb4b4dd79c7c4bbac23f2f4a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:41.789230 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01d6058fb4b4dd79c7c4bbac23f2f4a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:41.791340 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:41.911058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01d6058fb4b4dd79c7c4bbac23f2f4a', 'request_id': 'req-32b622bc-8a24-400b-ae88-6085adc62f76'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.911058 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:41.914897 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01d6058fb4b4dd79c7c4bbac23f2f4a', 'request_id': 'req-32b622bc-8a24-400b-ae88-6085adc62f76'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.921754 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01d6058fb4b4dd79c7c4bbac23f2f4a', 'request_id': 'req-32b622bc-8a24-400b-ae88-6085adc62f76'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.989981 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] The token cache is being invalidate because project e01d6058fb4b4dd79c7c4bbac23f2f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:41.993626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.993626 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:41.994881 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1413/2846] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:41 2022] DELETE /identity/v3/projects/e01d6058fb4b4dd79c7c4bbac23f2f4a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:41.998958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:42.009330 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aea55-465c-4996-b25b-c34f340f6393 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:42.066313 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:42.067220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:42.067502 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:42.067777 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] PATH_INFO: `/v3/users/ba051077e940493981a3421f840bdd5c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:42.068952 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba051077e940493981a3421f840bdd5c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:42.070939 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:42.267922 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba051077e940493981a3421f840bdd5c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:42.280974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba051077e940493981a3421f840bdd5c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:42.357428 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba051077e940493981a3421f840bdd5c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:42.358043 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba051077e940493981a3421f840bdd5c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:42.358749 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba051077e940493981a3421f840bdd5c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:42.371863 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1434/2847] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:41 2022] DELETE /identity/v3/users/ba051077e940493981a3421f840bdd5c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:42.771118 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:42.772601 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:42.787671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b622bc-8a24-400b-ae88-6085adc62f76 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:42.845675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:42.846533 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:42.846868 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:42.847116 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] PATH_INFO: `/v3/projects/0ace7795f2ce4accbf101d3806714865` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:42.848280 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ace7795f2ce4accbf101d3806714865)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:42.850172 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:42.969078 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ace7795f2ce4accbf101d3806714865', 'request_id': 'req-b52f2643-368f-4383-9d67-289e63597d87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:42.974717 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ace7795f2ce4accbf101d3806714865', 'request_id': 'req-b52f2643-368f-4383-9d67-289e63597d87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:42.981056 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ace7795f2ce4accbf101d3806714865', 'request_id': 'req-b52f2643-368f-4383-9d67-289e63597d87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.049859 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] The token cache is being invalidate because project 0ace7795f2ce4accbf101d3806714865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:43.050047 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.050815 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.055397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1414/2848] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:42 2022] DELETE /identity/v3/projects/0ace7795f2ce4accbf101d3806714865 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:43.057005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:43.058398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:43.072364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dab8d8-eafb-49e0-8a82-e5bae7cfb73e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:43.105063 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:43.129031 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:43.129911 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:43.130192 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:43.130469 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] PATH_INFO: `/v3/users/344bf964824e4305adfaeaa08afd0044` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:43.131742 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344bf964824e4305adfaeaa08afd0044)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:43.133836 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:43.359011 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344bf964824e4305adfaeaa08afd0044'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.371800 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344bf964824e4305adfaeaa08afd0044'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.465918 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344bf964824e4305adfaeaa08afd0044'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.466563 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344bf964824e4305adfaeaa08afd0044'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.467217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344bf964824e4305adfaeaa08afd0044'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:43.482621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1435/2849] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:43 2022] DELETE /identity/v3/users/344bf964824e4305adfaeaa08afd0044 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:43.753647 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:43.755214 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:43.815166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f2643-368f-4383-9d67-289e63597d87 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:43.839578 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:43.867607 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:43.868514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:43.868644 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:43.868857 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:43.870780 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:43.927213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:43.928643 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:43.937761 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1415/2850] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:43.971720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:43.973450 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:44.049741 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860e639-55f9-43e8-8e66-8a5eacfd8fa3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:44.054368 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:44.055344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:44.055621 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:44.055943 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] PATH_INFO: `/v3/projects/68c51bf2cd1749a5ba841121c9c7e889` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:44.057126 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c51bf2cd1749a5ba841121c9c7e889)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:44.059091 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:44.187052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c51bf2cd1749a5ba841121c9c7e889', 'request_id': 'req-9e163370-ddeb-4492-ae1e-ef6efa2da37d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:44.300333 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c51bf2cd1749a5ba841121c9c7e889', 'request_id': 'req-9e163370-ddeb-4492-ae1e-ef6efa2da37d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:44.301901 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:44.307929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c51bf2cd1749a5ba841121c9c7e889', 'request_id': 'req-9e163370-ddeb-4492-ae1e-ef6efa2da37d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:44.319305 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] The token cache is being invalidate because project 68c51bf2cd1749a5ba841121c9c7e889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:44.319596 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:44.320278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e163370-ddeb-4492-ae1e-ef6efa2da37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:44.322946 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1436/2851] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:43 2022] DELETE /identity/v3/projects/68c51bf2cd1749a5ba841121c9c7e889 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:47.848537 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:47.850504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:47.870487 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdb6be-a1f9-403c-9435-4eaede2e6e75 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:47.928992 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:47.929988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:47.931012 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:47.931300 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] PATH_INFO: `/v3/users/89364925f42c424988162e2ec801628f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:47.932513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89364925f42c424988162e2ec801628f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:47.934602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:48.170936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89364925f42c424988162e2ec801628f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:48.183747 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89364925f42c424988162e2ec801628f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:48.184514 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89364925f42c424988162e2ec801628f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:48.254429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89364925f42c424988162e2ec801628f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:48.255080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89364925f42c424988162e2ec801628f'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:48.263866 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:48.269741 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1416/2852] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:47 2022] DELETE /identity/v3/users/89364925f42c424988162e2ec801628f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 15:42:48.274238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:48.277236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:48.277236 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:48.292461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:48.293953 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:48.353755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1437/2853] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:48.363328 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:48.364742 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:48.423898 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7eac-071a-42ca-aa9c-e63201c2c2d8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:48.427360 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:48.427989 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:48.428270 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:48.428540 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:48.438850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:48.440281 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:48.450616 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1417/2854] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:48.860234 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:48.861681 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:48.874461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04e8b7-2764-4a69-8892-f257b86cd828 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:48.879706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:48.880622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:48.880906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:48.881183 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] PATH_INFO: `/v3/projects/4041369aeb6544ebbbea7a930378a9d6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:48.890354 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4041369aeb6544ebbbea7a930378a9d6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:48.892364 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:48.990870 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4041369aeb6544ebbbea7a930378a9d6', 'request_id': 'req-038731c7-ee05-481f-b2d0-bcf10d4ae74d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.054476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4041369aeb6544ebbbea7a930378a9d6', 'request_id': 'req-038731c7-ee05-481f-b2d0-bcf10d4ae74d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.061002 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4041369aeb6544ebbbea7a930378a9d6', 'request_id': 'req-038731c7-ee05-481f-b2d0-bcf10d4ae74d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.072651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] The token cache is being invalidate because project 4041369aeb6544ebbbea7a930378a9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:49.072938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.073573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.075188 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1438/2855] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:48 2022] DELETE /identity/v3/projects/4041369aeb6544ebbbea7a930378a9d6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:49.079183 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:49.089181 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79a11e-1d53-4e0b-988a-a70a8bc89969 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:49.146211 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:49.147109 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:49.147397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:49.147675 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] PATH_INFO: `/v3/users/57727c23ad1549d087a15e0b341dd2ad` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:49.148854 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57727c23ad1549d087a15e0b341dd2ad)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:49.150802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:49.351872 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57727c23ad1549d087a15e0b341dd2ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.364457 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57727c23ad1549d087a15e0b341dd2ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.365154 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57727c23ad1549d087a15e0b341dd2ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.437408 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57727c23ad1549d087a15e0b341dd2ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.438084 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57727c23ad1549d087a15e0b341dd2ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:49.452161 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1418/2856] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:49 2022] DELETE /identity/v3/users/57727c23ad1549d087a15e0b341dd2ad => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:49.896656 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:49.898151 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:49.911984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038731c7-ee05-481f-b2d0-bcf10d4ae74d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:49.972197 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:49.973055 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:49.973336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:49.973610 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] PATH_INFO: `/v3/projects/d019253ce95d4250b092abc7e2daa1f4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:49.974814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d019253ce95d4250b092abc7e2daa1f4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:49.976706 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:49.987402 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:50.077224 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd019253ce95d4250b092abc7e2daa1f4', 'request_id': 'req-86aa39e3-40f1-421b-87cc-a83b2020ce11'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.163108 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd019253ce95d4250b092abc7e2daa1f4', 'request_id': 'req-86aa39e3-40f1-421b-87cc-a83b2020ce11'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.169243 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd019253ce95d4250b092abc7e2daa1f4', 'request_id': 'req-86aa39e3-40f1-421b-87cc-a83b2020ce11'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.180914 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] The token cache is being invalidate because project d019253ce95d4250b092abc7e2daa1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:50.181235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.181881 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.183508 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1439/2857] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:49 2022] DELETE /identity/v3/projects/d019253ce95d4250b092abc7e2daa1f4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:50.187569 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:50.194529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:50.202429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f88d-e2e7-4903-bf89-a0800e55da11 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:50.219590 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:50.259917 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:50.260794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:50.261074 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:50.261346 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] PATH_INFO: `/v3/users/065ab78fe9dd4aa28a758ed8b22c0644` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:50.262527 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=065ab78fe9dd4aa28a758ed8b22c0644)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:50.264588 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:50.462620 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065ab78fe9dd4aa28a758ed8b22c0644'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.474071 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065ab78fe9dd4aa28a758ed8b22c0644'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.474765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065ab78fe9dd4aa28a758ed8b22c0644'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.557559 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065ab78fe9dd4aa28a758ed8b22c0644'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.558182 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-db0849ea-4280-431b-86c7-697226fdcb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065ab78fe9dd4aa28a758ed8b22c0644'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:50.570618 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1419/2858] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:42:50 2022] DELETE /identity/v3/users/065ab78fe9dd4aa28a758ed8b22c0644 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:50.981392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:50.983052 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:50.998677 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa39e3-40f1-421b-87cc-a83b2020ce11 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:51.061238 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:51.062110 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.062423 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.062736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] PATH_INFO: `/v3/projects/a48d594e78344d3fb789053286a39b83` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.064001 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48d594e78344d3fb789053286a39b83)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:51.065948 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:51.187150 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48d594e78344d3fb789053286a39b83', 'request_id': 'req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:51.260332 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48d594e78344d3fb789053286a39b83', 'request_id': 'req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:51.266062 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48d594e78344d3fb789053286a39b83', 'request_id': 'req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:51.277103 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] The token cache is being invalidate because project a48d594e78344d3fb789053286a39b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:42:51.277389 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:51.278019 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f5db7e9-7e88-44de-90ab-b5e24dbe4ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:42:51.279648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1440/2859] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:42:50 2022] DELETE /identity/v3/projects/a48d594e78344d3fb789053286a39b83 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:51.285511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275a67-e159-40cc-871c-2c6614f323a5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.285983 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275a67-e159-40cc-871c-2c6614f323a5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.286105 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275a67-e159-40cc-871c-2c6614f323a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.303730 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-21275a67-e159-40cc-871c-2c6614f323a5 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:51.304948 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21275a67-e159-40cc-871c-2c6614f323a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:51.363677 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1420/2860] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:51.372814 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd96e5-3d85-4a3f-8bce-634fdcac0678 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.373106 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd96e5-3d85-4a3f-8bce-634fdcac0678 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.373384 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd96e5-3d85-4a3f-8bce-634fdcac0678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.392536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-82cd96e5-3d85-4a3f-8bce-634fdcac0678 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:51.393736 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-82cd96e5-3d85-4a3f-8bce-634fdcac0678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:51.402093 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1441/2861] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:51.406206 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21275a67-e159-40cc-871c-2c6614f323a5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:51.416343 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21275a67-e159-40cc-871c-2c6614f323a5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:51.421229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:51.421877 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.422163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.422440 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.423210 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:42:51.423522 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:51.425114 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:51.437532 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1421/2862] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:42:51.441726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd96e5-3d85-4a3f-8bce-634fdcac0678 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:51.452148 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd96e5-3d85-4a3f-8bce-634fdcac0678 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:51.456969 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:51.457622 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.457905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.458181 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.458938 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:51.460852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:51.558624 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:51.565079 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1442/2863] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:51 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:51.569242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:51.580290 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c33c60-6f4b-4818-94d0-2ab7c81c2f15 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:51.605415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:51.638447 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:51.639164 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.639453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.639732 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.640430 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:51.642394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:51.739809 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1422/2864] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:51 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:51.744690 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:51.756565 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5394a5e-98f7-4908-9ec1-fcc4416c8cab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:51.761937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:51.764301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.764301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.764301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.764301 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:51.765536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:51.775885 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1443/2865] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:51.779669 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:51.789369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62cd48-6b09-42e0-b9a4-f3f5efd1d5b6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:51.794426 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856eb6-fee6-440c-bb3c-f7b1bd0fb9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:51.795117 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856eb6-fee6-440c-bb3c-f7b1bd0fb9af admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.795399 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856eb6-fee6-440c-bb3c-f7b1bd0fb9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.795676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856eb6-fee6-440c-bb3c-f7b1bd0fb9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.796401 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856eb6-fee6-440c-bb3c-f7b1bd0fb9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:51.797970 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856eb6-fee6-440c-bb3c-f7b1bd0fb9af admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:51.808704 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1423/2866] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:51.812638 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:51.823186 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21adb83-bc51-45d6-8270-4d92ec69800d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:51.827984 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:51.828862 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.829147 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.829426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] PATH_INFO: `/v3/projects/73cb9e26f73e410aa7baa2083cdea3d6/users/f1921b1fde5040b4bfa5c6085e504801/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.843651 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73cb9e26f73e410aa7baa2083cdea3d6, user_id=f1921b1fde5040b4bfa5c6085e504801, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:51.846300 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:51.934755 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1444/2867] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:51 2022] PUT /identity/v3/projects/73cb9e26f73e410aa7baa2083cdea3d6/users/f1921b1fde5040b4bfa5c6085e504801/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:51.939775 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fb54-1fe6-47c3-8c0f-33e692fccce2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:51.940122 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fb54-1fe6-47c3-8c0f-33e692fccce2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:51.941844 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0fb54-1fe6-47c3-8c0f-33e692fccce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:51.958691 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a6d0fb54-1fe6-47c3-8c0f-33e692fccce2 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:51.959894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a6d0fb54-1fe6-47c3-8c0f-33e692fccce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:52.018663 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1424/2868] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:52.028237 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:52.029986 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:52.088036 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccabb1-3c7e-4499-9fcc-6aeac820ba4b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:52.091693 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:52.092340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:52.092628 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:52.092906 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:52.101887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:52.103910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:52.113286 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1445/2869] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:53.360140 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021f23-c785-4f62-8cc2-036670bd4fa3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:53.360709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021f23-c785-4f62-8cc2-036670bd4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:53.360709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021f23-c785-4f62-8cc2-036670bd4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:53.389671 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d5021f23-c785-4f62-8cc2-036670bd4fa3 None None] MFA Rules not processed for user `f1921b1fde5040b4bfa5c6085e504801`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:53.390964 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d5021f23-c785-4f62-8cc2-036670bd4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:53.463110 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1425/2870] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:53.467684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:53.478241 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c370f4-5560-48dd-8802-cc1ba25c5a82 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:53.483683 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:53.484341 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:53.484633 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:53.484917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:53.485616 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:53.487608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:53.577730 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1446/2871] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:42:53 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:42:53.581636 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021f23-c785-4f62-8cc2-036670bd4fa3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:53.593674 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021f23-c785-4f62-8cc2-036670bd4fa3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:53.627922 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:53.651850 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:53.652509 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:53.652791 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:53.653066 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:53.653757 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:53.655701 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:53.763267 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1426/2872] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:42:53 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:42:53.767280 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:53.777847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead8044-2d86-4c74-b346-ac247b365350 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:53.783717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:53.783717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:53.783717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:53.783717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:53.784397 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:53.785979 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:53.797540 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1447/2873] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:53.801653 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:53.812253 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb32b45-cf80-4354-8e18-133994ed1052 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:53.816890 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:53.817768 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:53.818051 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:53.818330 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] PATH_INFO: `/v3/projects/b6ae30829fd14f6bb4e3b44cab5cfe34/users/31aa4d0c00cb4b8f8b71a2de2a449b87/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:53.834985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ae30829fd14f6bb4e3b44cab5cfe34, user_id=31aa4d0c00cb4b8f8b71a2de2a449b87, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:53.837655 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:53.910202 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1427/2874] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:53 2022] PUT /identity/v3/projects/b6ae30829fd14f6bb4e3b44cab5cfe34/users/31aa4d0c00cb4b8f8b71a2de2a449b87/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:53.914172 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:53.925185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620d1c-02bd-449d-98fd-ffc6190a6d4c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:53.985424 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed7928-d159-4e66-8071-61c5208922a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:53.986094 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed7928-d159-4e66-8071-61c5208922a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:53.986377 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed7928-d159-4e66-8071-61c5208922a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:53.986665 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed7928-d159-4e66-8071-61c5208922a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:53.987403 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed7928-d159-4e66-8071-61c5208922a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:53.989041 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed7928-d159-4e66-8071-61c5208922a3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:54.000012 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1448/2875] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:42:54.004243 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:54.015960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcbe10-64ca-4a7c-8ccd-cd7644caf0d5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:54.020609 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cf3c6-0d3f-4fcd-b631-e459c05b609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:54.021490 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cf3c6-0d3f-4fcd-b631-e459c05b609b admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:54.021782 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cf3c6-0d3f-4fcd-b631-e459c05b609b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:54.022057 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cf3c6-0d3f-4fcd-b631-e459c05b609b admin admin] PATH_INFO: `/v3/projects/b6ae30829fd14f6bb4e3b44cab5cfe34/users/31aa4d0c00cb4b8f8b71a2de2a449b87/roles/ce14b9adc23a4229a8205f422f2f8a76` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:54.024341 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cf3c6-0d3f-4fcd-b631-e459c05b609b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ae30829fd14f6bb4e3b44cab5cfe34, user_id=31aa4d0c00cb4b8f8b71a2de2a449b87, role_id=ce14b9adc23a4229a8205f422f2f8a76)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:54.027007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cf3c6-0d3f-4fcd-b631-e459c05b609b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:54.037177 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1428/2876] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:42:54 2022] PUT /identity/v3/projects/b6ae30829fd14f6bb4e3b44cab5cfe34/users/31aa4d0c00cb4b8f8b71a2de2a449b87/roles/ce14b9adc23a4229a8205f422f2f8a76 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:42:55.336249 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:55.337392 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:55.337528 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:55.364215 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] MFA Rules not processed for user `31aa4d0c00cb4b8f8b71a2de2a449b87`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:55.365678 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:55.385212 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:55.434929 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1449/2877] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:55.446387 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3fa4-f8f5-42ca-97cc-25ee47269e42 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:55.448499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3fa4-f8f5-42ca-97cc-25ee47269e42 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:55.448499 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3fa4-f8f5-42ca-97cc-25ee47269e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:55.465755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-765c3fa4-f8f5-42ca-97cc-25ee47269e42 None None] MFA Rules not processed for user `f1921b1fde5040b4bfa5c6085e504801`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:42:55.466986 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-765c3fa4-f8f5-42ca-97cc-25ee47269e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:55.523229 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1429/2878] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:42:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:42:55.536072 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:55.537541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:55.610748 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe8176-8ef9-406f-baf2-7240a17ed84e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:55.616248 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:55.616895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:55.617182 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:55.617968 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:55.625798 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:55.627513 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:55.637328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1450/2879] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:56.135988 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c3fa4-f8f5-42ca-97cc-25ee47269e42 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:56.190311 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c3fa4-f8f5-42ca-97cc-25ee47269e42 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:56.193813 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:56.194445 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:56.194765 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:56.195045 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:56.197433 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:56.206933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:56.208366 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:56.216894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1430/2880] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:56.607039 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:56.608533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:56.682615 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbb6a8-404f-463d-b107-f781a05b4899 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:56.687717 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:56.688365 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:56.688654 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:56.688937 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:56.690784 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:56.702852 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:56.704426 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:56.715053 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1451/2881] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:42:59.755951 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:42:59.764729 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990028b-e897-40c1-9078-d6d7757326a5 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:42:59.768338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:42:59.768972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:42:59.769258 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:42:59.769536 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:42:59.771405 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:42:59.780985 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:42:59.782443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:42:59.790982 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1431/2882] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:42:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:43:06.710087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:07.202325 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:07.215912 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e262fa-ea46-4880-851e-02d2c507ee0b service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:07.221556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7816f91ee6e489dbe9642b5bd25a454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:07.222217 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:07.222504 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:07.222847 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:07.224684 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:07.237819 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:07.239493 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:07.252275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1452/2883] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:43:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:43:09.786975 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:12.814432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:12.815842 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:12.871695 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f961717-889b-46d8-a31f-923db0e048f2 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:12.875225 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:12.875855 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:12.876136 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:12.876407 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:12.885972 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:12.887422 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:12.896788 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1432/2884] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:43:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:43:17.247644 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:22.892504 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=26 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:36.757034 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:36.768593 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870215e-2d0b-4208-9be8-6122cebeb6e4 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:36.773620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:36.774256 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:36.774541 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:36.774849 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:36.776608 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:36.789082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:36.790685 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:36.802240 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1453/2885] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:43:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:43:36.894207 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:36.958744 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b8bcb-5d4f-47c5-8f7d-a78cfcba2c81 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:36.963278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:36.964145 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:36.964480 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:36.964755 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] PATH_INFO: `/v3/users/f1921b1fde5040b4bfa5c6085e504801` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:36.965938 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1921b1fde5040b4bfa5c6085e504801)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:36.967960 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:37.148276 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1921b1fde5040b4bfa5c6085e504801'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.160131 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1921b1fde5040b4bfa5c6085e504801'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.160805 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1921b1fde5040b4bfa5c6085e504801'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.223415 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1921b1fde5040b4bfa5c6085e504801'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.223959 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1921b1fde5040b4bfa5c6085e504801'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.236694 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1433/2886] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:43:36 2022] DELETE /identity/v3/users/f1921b1fde5040b4bfa5c6085e504801 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:43:37.471340 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:37.484578 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc690-d817-4491-ad16-cf16a3f62798 service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:37.544463 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:37.545331 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:37.545610 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:37.545882 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] PATH_INFO: `/v3/projects/73cb9e26f73e410aa7baa2083cdea3d6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:37.547084 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73cb9e26f73e410aa7baa2083cdea3d6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:37.549680 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:37.658949 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73cb9e26f73e410aa7baa2083cdea3d6', 'request_id': 'req-89be20fe-e746-4d84-b49a-028457384cc5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.721075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73cb9e26f73e410aa7baa2083cdea3d6', 'request_id': 'req-89be20fe-e746-4d84-b49a-028457384cc5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.727009 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73cb9e26f73e410aa7baa2083cdea3d6', 'request_id': 'req-89be20fe-e746-4d84-b49a-028457384cc5'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.738517 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] The token cache is being invalidate because project 73cb9e26f73e410aa7baa2083cdea3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:43:37.738840 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.739479 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:37.741022 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1454/2887] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:43:37 2022] DELETE /identity/v3/projects/73cb9e26f73e410aa7baa2083cdea3d6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:43:37.744976 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:37.746367 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:37.761429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923e70-32eb-40b9-a4e0-ba1be9cde71b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:37.819087 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:37.819998 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:37.820283 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:37.820561 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] PATH_INFO: `/v3/users/31aa4d0c00cb4b8f8b71a2de2a449b87` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:37.821783 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31aa4d0c00cb4b8f8b71a2de2a449b87)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:37.823753 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:37.845884 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:38.066138 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31aa4d0c00cb4b8f8b71a2de2a449b87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.081829 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31aa4d0c00cb4b8f8b71a2de2a449b87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.082597 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31aa4d0c00cb4b8f8b71a2de2a449b87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.151709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31aa4d0c00cb4b8f8b71a2de2a449b87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.152421 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b9132ef1-7626-4ffe-a6b9-89a13cc63476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31aa4d0c00cb4b8f8b71a2de2a449b87'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.166148 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1434/2888] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:43:37 2022] DELETE /identity/v3/users/31aa4d0c00cb4b8f8b71a2de2a449b87 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:43:38.457251 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:38.458774 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:38.482958 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be20fe-e746-4d84-b49a-028457384cc5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:38.544720 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:38.545589 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:38.545879 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:38.546156 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] PATH_INFO: `/v3/projects/b6ae30829fd14f6bb4e3b44cab5cfe34` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:38.547981 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ae30829fd14f6bb4e3b44cab5cfe34)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:38.550235 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:38.572210 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:38.660443 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ae30829fd14f6bb4e3b44cab5cfe34', 'request_id': 'req-0acec512-47de-4f05-978b-56a4b0f1dd3d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.728974 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ae30829fd14f6bb4e3b44cab5cfe34', 'request_id': 'req-0acec512-47de-4f05-978b-56a4b0f1dd3d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.735575 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ae30829fd14f6bb4e3b44cab5cfe34', 'request_id': 'req-0acec512-47de-4f05-978b-56a4b0f1dd3d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.746959 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] The token cache is being invalidate because project b6ae30829fd14f6bb4e3b44cab5cfe34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:43:38.747275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.747905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0acec512-47de-4f05-978b-56a4b0f1dd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:43:38.749511 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1455/2889] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:43:38 2022] DELETE /identity/v3/projects/b6ae30829fd14f6bb4e3b44cab5cfe34 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:43:38.754614 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca772bc-fdc5-4fa8-84d9-2d84f7720085 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:38.754936 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca772bc-fdc5-4fa8-84d9-2d84f7720085 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:38.756097 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca772bc-fdc5-4fa8-84d9-2d84f7720085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:38.773502 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bca772bc-fdc5-4fa8-84d9-2d84f7720085 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:43:38.774750 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bca772bc-fdc5-4fa8-84d9-2d84f7720085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:38.833242 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1435/2890] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:43:38.841309 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6875-8048-4126-8568-ebb122c64169 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:38.841672 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6875-8048-4126-8568-ebb122c64169 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:38.842024 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d6875-8048-4126-8568-ebb122c64169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:38.861189 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-984d6875-8048-4126-8568-ebb122c64169 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:43:38.862411 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-984d6875-8048-4126-8568-ebb122c64169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:38.870499 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1456/2891] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:43:38.874801 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca772bc-fdc5-4fa8-84d9-2d84f7720085 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:38.884602 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca772bc-fdc5-4fa8-84d9-2d84f7720085 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:38.889228 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:38.889882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:38.890166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:38.890443 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:38.891724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:43:38.892034 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:38.893645 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:38.905088 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1436/2892] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:43:38.909850 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6875-8048-4126-8568-ebb122c64169 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:38.919042 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d6875-8048-4126-8568-ebb122c64169 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:38.924487 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:38.925131 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:38.925416 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:38.925697 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:38.926379 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:38.928455 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:39.027430 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1457/2893] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:43:38 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:43:39.031542 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:39.042873 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e30917-c983-4972-b4b7-fafdc77627cd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:39.099495 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:39.100163 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:39.100450 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:39.100731 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:39.101419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:39.103395 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:39.225419 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1437/2894] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:43:39 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:43:39.229458 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:39.239752 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04254f45-5dd3-4fe5-b687-96c66caf107b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:39.244343 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:39.244995 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:39.245281 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:39.245556 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:39.246275 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:39.247917 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:39.258887 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1458/2895] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:43:39.262880 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:39.273802 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040917c-2f29-4454-ab09-67ce0e2ebeeb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:39.278483 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb66bd8-9179-4e34-a8b5-ee8dc2f9fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:39.279103 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb66bd8-9179-4e34-a8b5-ee8dc2f9fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:39.279394 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb66bd8-9179-4e34-a8b5-ee8dc2f9fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:39.279676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb66bd8-9179-4e34-a8b5-ee8dc2f9fbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:39.280476 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb66bd8-9179-4e34-a8b5-ee8dc2f9fbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:39.282454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb66bd8-9179-4e34-a8b5-ee8dc2f9fbd1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:39.293724 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1438/2896] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:43:39.298068 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:39.307998 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44706e39-768e-4f40-9f1e-2920eb79fb22 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:39.312536 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:39.314075 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:39.314226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:39.314445 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] PATH_INFO: `/v3/projects/8c1d62a40a644ecfb3f45638bb4b98b2/users/583fb0c511f2426d89457a5ad3b79031/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:39.329398 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1d62a40a644ecfb3f45638bb4b98b2, user_id=583fb0c511f2426d89457a5ad3b79031, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:39.332177 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:39.477831 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1459/2897] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:43:39 2022] PUT /identity/v3/projects/8c1d62a40a644ecfb3f45638bb4b98b2/users/583fb0c511f2426d89457a5ad3b79031/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:43:39.489315 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864e4f-b1dc-493f-991d-56b50936abbd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:39.489598 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864e4f-b1dc-493f-991d-56b50936abbd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:39.489869 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864e4f-b1dc-493f-991d-56b50936abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:39.498529 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:39.520067 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f1864e4f-b1dc-493f-991d-56b50936abbd None None] MFA Rules not processed for user `583fb0c511f2426d89457a5ad3b79031`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:43:39.521282 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1864e4f-b1dc-493f-991d-56b50936abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:39.584112 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1439/2898] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:43:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:43:39.595702 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:43:39.597374 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:43:39.676393 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7274-1fb6-46be-b04b-12e20b639e0e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:43:39.680232 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe8f1-8daa-480c-a60e-c205f384d20a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d166e2866794925bd5bde02040239dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:43:39.680889 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe8f1-8daa-480c-a60e-c205f384d20a service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:43:39.681178 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe8f1-8daa-480c-a60e-c205f384d20a service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:43:39.681461 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe8f1-8daa-480c-a60e-c205f384d20a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:43:39.690226 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe8f1-8daa-480c-a60e-c205f384d20a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:43:39.691704 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfe8f1-8daa-480c-a60e-c205f384d20a service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:43:39.700709 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1460/2899] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:43:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:43:49.641556 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=30 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:49.697056 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:59.953752 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864e4f-b1dc-493f-991d-56b50936abbd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:00.016086 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864e4f-b1dc-493f-991d-56b50936abbd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:00.020632 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:00.021492 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:00.021776 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:00.022052 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] PATH_INFO: `/v3/users/583fb0c511f2426d89457a5ad3b79031` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:00.023268 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583fb0c511f2426d89457a5ad3b79031)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:00.025190 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:00.239579 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583fb0c511f2426d89457a5ad3b79031'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:00.251398 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583fb0c511f2426d89457a5ad3b79031'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:00.252059 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583fb0c511f2426d89457a5ad3b79031'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:00.317092 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583fb0c511f2426d89457a5ad3b79031'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:00.317708 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583fb0c511f2426d89457a5ad3b79031'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:00.330278 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1440/2900] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:43:59 2022] DELETE /identity/v3/users/583fb0c511f2426d89457a5ad3b79031 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:44:00.335386 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:00.335894 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:00.336005 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:00.354474 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:44:00.355771 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:00.414515 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1461/2901] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:44:00.424795 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:00.427194 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:00.484619 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e446674-3ec3-4587-96b9-9dfe8803dc46 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:00.488338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b790e1a-49be-46ad-9fc1-48e226c58d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:00.488956 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b790e1a-49be-46ad-9fc1-48e226c58d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:00.489236 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b790e1a-49be-46ad-9fc1-48e226c58d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:00.489510 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b790e1a-49be-46ad-9fc1-48e226c58d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:00.498794 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b790e1a-49be-46ad-9fc1-48e226c58d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:00.500160 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b790e1a-49be-46ad-9fc1-48e226c58d13 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:00.510007 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1441/2902] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:44:00.919054 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:00.920727 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:00.933910 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73560c46-1c65-4798-85a2-5774ab76521a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:00.938789 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:00.939655 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:00.939935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:00.940208 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] PATH_INFO: `/v3/projects/8c1d62a40a644ecfb3f45638bb4b98b2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:00.942576 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1d62a40a644ecfb3f45638bb4b98b2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:00.945146 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.043058 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1d62a40a644ecfb3f45638bb4b98b2', 'request_id': 'req-e2b0a76b-5119-4d13-9d75-a350d9f990a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:01.111533 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1d62a40a644ecfb3f45638bb4b98b2', 'request_id': 'req-e2b0a76b-5119-4d13-9d75-a350d9f990a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:01.118128 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1d62a40a644ecfb3f45638bb4b98b2', 'request_id': 'req-e2b0a76b-5119-4d13-9d75-a350d9f990a2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:01.130319 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] The token cache is being invalidate because project 8c1d62a40a644ecfb3f45638bb4b98b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:44:01.130607 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:01.131285 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e2b0a76b-5119-4d13-9d75-a350d9f990a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:01.132822 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1462/2903] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:44:00 2022] DELETE /identity/v3/projects/8c1d62a40a644ecfb3f45638bb4b98b2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:44:01.137840 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03364659-4295-4abd-ac8a-5048e302fe7c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.138393 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03364659-4295-4abd-ac8a-5048e302fe7c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.138513 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03364659-4295-4abd-ac8a-5048e302fe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.156721 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-03364659-4295-4abd-ac8a-5048e302fe7c None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:44:01.157991 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-03364659-4295-4abd-ac8a-5048e302fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:01.175129 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:01.217979 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1442/2904] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:44:01.227278 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3354f1-d836-4617-8a78-6e6ca7b9f160 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.227573 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3354f1-d836-4617-8a78-6e6ca7b9f160 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.227884 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3354f1-d836-4617-8a78-6e6ca7b9f160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.246304 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-da3354f1-d836-4617-8a78-6e6ca7b9f160 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:44:01.247648 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da3354f1-d836-4617-8a78-6e6ca7b9f160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:01.256671 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1463/2905] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:44:01.260876 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03364659-4295-4abd-ac8a-5048e302fe7c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:01.271889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03364659-4295-4abd-ac8a-5048e302fe7c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:01.276517 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:01.277166 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.277453 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.277734 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.278464 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 15:44:01.278821 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:01.280417 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.291800 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1443/2906] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Jul 20 15:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 15:44:01.296221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3354f1-d836-4617-8a78-6e6ca7b9f160 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:01.306344 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3354f1-d836-4617-8a78-6e6ca7b9f160 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:01.311101 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:01.311747 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.312030 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.312307 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.313000 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:01.314905 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.392801 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1464/2907] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Jul 20 15:44:01 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 15:44:01.396785 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:01.406824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af4ac-aedd-496e-b3fd-7d17b470651a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:01.463016 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:01.463676 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.463962 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.464241 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.464924 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:01.466882 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.567843 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1444/2908] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Jul 20 15:44:01 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 15:44:01.571900 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:01.582466 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e78d0-024b-48e5-8e2e-3986efc169fa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:01.587255 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:01.590448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.590448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.590448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.590448 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:01.590895 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.601640 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1465/2909] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:44:01.605462 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:01.616176 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66adb-b54a-46b5-9d2d-89c0a5eb0d7a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:01.620735 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c7f51-187a-4bb2-a91a-6df03867f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:01.621385 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7f51-187a-4bb2-a91a-6df03867f056 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.621688 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7f51-187a-4bb2-a91a-6df03867f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.621963 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7f51-187a-4bb2-a91a-6df03867f056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.622709 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c7f51-187a-4bb2-a91a-6df03867f056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:01.624285 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c7f51-187a-4bb2-a91a-6df03867f056 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.635338 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1445/2910] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Jul 20 15:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 15:44:01.639406 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:01.649476 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c70f-47f1-4f63-b1d9-22280c2a0d9f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:01.654125 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:01.655043 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.655336 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.655620 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] PATH_INFO: `/v3/projects/d7dd23603d384461a4f86fd6143596cc/users/fe038b68f930443a9a7657601f46a0ad/roles/6ad1c431efee442b8f305d707b3adc85` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.671907 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dd23603d384461a4f86fd6143596cc, user_id=fe038b68f930443a9a7657601f46a0ad, role_id=6ad1c431efee442b8f305d707b3adc85)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:01.674799 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.744185 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1466/2911] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Jul 20 15:44:01 2022] PUT /identity/v3/projects/d7dd23603d384461a4f86fd6143596cc/users/fe038b68f930443a9a7657601f46a0ad/roles/6ad1c431efee442b8f305d707b3adc85 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:44:01.762566 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc753-38e1-4fd3-a448-7033bc09b3be None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.762894 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc753-38e1-4fd3-a448-7033bc09b3be None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.763180 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbc753-38e1-4fd3-a448-7033bc09b3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.789766 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-69fbc753-38e1-4fd3-a448-7033bc09b3be None None] MFA Rules not processed for user `fe038b68f930443a9a7657601f46a0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:44:01.791013 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-69fbc753-38e1-4fd3-a448-7033bc09b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:01.853432 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1446/2912] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:44:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 15:44:01.864061 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:01.865715 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:01.887740 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:01.922591 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ea24-e547-445e-af74-819ed394b98e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:01.926409 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60502f7-28c3-4bd2-b1d7-6f14c1804aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e49a95b86044f5aa9ff4a084ee8cee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:01.927087 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60502f7-28c3-4bd2-b1d7-6f14c1804aca service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:01.927370 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60502f7-28c3-4bd2-b1d7-6f14c1804aca service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:01.927647 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60502f7-28c3-4bd2-b1d7-6f14c1804aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:01.935960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60502f7-28c3-4bd2-b1d7-6f14c1804aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:01.937376 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60502f7-28c3-4bd2-b1d7-6f14c1804aca service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:01.946954 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1467/2913] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:44:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:44:08.502193 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc753-38e1-4fd3-a448-7033bc09b3be None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:08.522286 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:08.565082 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbc753-38e1-4fd3-a448-7033bc09b3be None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:08.570284 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:08.571186 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:08.571472 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:08.571749 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] PATH_INFO: `/v3/users/fe038b68f930443a9a7657601f46a0ad` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:08.572933 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe038b68f930443a9a7657601f46a0ad)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:08.574889 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:08.728080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe038b68f930443a9a7657601f46a0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:08.741557 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe038b68f930443a9a7657601f46a0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:08.742234 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe038b68f930443a9a7657601f46a0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:08.831454 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe038b68f930443a9a7657601f46a0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:08.832080 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe038b68f930443a9a7657601f46a0ad'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:08.844811 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1447/2914] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Jul 20 15:44:08 2022] DELETE /identity/v3/users/fe038b68f930443a9a7657601f46a0ad => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:44:08.849557 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:08.850082 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:08.850220 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:08.867942 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] MFA Rules not processed for user `45390c2d5e85402a95796746fd244a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 15:44:08.869122 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:08.926808 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1468/2915] 10.222.0.87 () {58 vars in 957 bytes} [Wed Jul 20 15:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 15:44:08.937503 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:08.938928 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:08.997213 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b06f5-101d-43b1-b3f3-ffd74b0fb1e3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:09.000830 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1c06e34aaac441e8b1a6366cc384524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:09.001470 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:09.001756 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:09.002036 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:09.011863 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:09.013369 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:09.023219 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1448/2916] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:44:09.433561 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:09.435328 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:09.450221 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd94c-3411-476e-a192-ec75a2fbfbe8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:09.455759 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45390c2d5e85402a95796746fd244a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f094b507fc2a4226a1c6a63fcbb399b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:09.457710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:09.457710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:09.457710 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] PATH_INFO: `/v3/projects/d7dd23603d384461a4f86fd6143596cc` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:09.458348 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dd23603d384461a4f86fd6143596cc)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:09.459960 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:09.580527 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dd23603d384461a4f86fd6143596cc', 'request_id': 'req-8b13162f-b9e9-4bb2-833d-7ee041679311'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:09.665509 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dd23603d384461a4f86fd6143596cc', 'request_id': 'req-8b13162f-b9e9-4bb2-833d-7ee041679311'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:09.671935 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dd23603d384461a4f86fd6143596cc', 'request_id': 'req-8b13162f-b9e9-4bb2-833d-7ee041679311'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:09.684130 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] The token cache is being invalidate because project d7dd23603d384461a4f86fd6143596cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 15:44:09.684446 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:09.685111 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8b13162f-b9e9-4bb2-833d-7ee041679311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 15:44:09.686726 dv-cinder-819149-12-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1469/2917] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Jul 20 15:44:09 2022] DELETE /identity/v3/projects/d7dd23603d384461a4f86fd6143596cc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 15:44:19.018651 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:19.680967 dv-cinder-819149-12-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:27.039429 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 15:44:27.041516 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:27.109967 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf2f1b-e76b-4480-a37a-530137ec977d service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 15:44:27.169291 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae95773-1190-4232-b0e4-3d699ebe86d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8f8e30141ca4c95b5c11afefbb324c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '081b73d4e6644ae189d605f40bae7d94', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 15:44:27.169941 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae95773-1190-4232-b0e4-3d699ebe86d6 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 15:44:27.170511 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae95773-1190-4232-b0e4-3d699ebe86d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 15:44:27.170824 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae95773-1190-4232-b0e4-3d699ebe86d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 15:44:27.172630 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2ae95773-1190-4232-b0e4-3d699ebe86d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 15:44:27.184792 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae95773-1190-4232-b0e4-3d699ebe86d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 15:44:27.186397 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae95773-1190-4232-b0e4-3d699ebe86d6 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 15:44:27.196460 dv-cinder-819149-12-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1449/2918] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Jul 20 15:44:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 15:44:37.192099 dv-cinder-819149-12-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=58 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}